fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! [feature] building up the schema again from scratch acording the section 11,4,1 in the bitag report

Author: marmoure

src/main/resources/schemas/sample.csv

@@ -1,6 +1,6 @@
-date_published,regulator_name,regulator_version_number,connection_type,fcc_registration_number,unique_plan_identifier,network_technology_type,provider_name,service_plan_name,bandwidth_download_units,bandwidth_download_marketed_low,bandwidth_download_marketed_high,bandwidth_download_typical_low,bandwidth_download_typical_high,bandwidth_upload_units,bandwidth_upload_marketed_low,bandwidth_upload_marketed_high,bandwidth_upload_typical_low,bandwidth_upload_typical_high,latency_idle_low,latency_idle_high,currency,price_type,price_details,price_recurring,fee_introductory,fee_introductory_description,contract_required,contract_details,contract_terms_uri,fee_one_time_amount,fee_one_time_details,fee_recurring,fee_recurring_description,fee_pass_through_recurring,fee_pass_through_recurring_description,fee_early_termination,fee_early_termination_description,government_taxes,policy_data_usage,fee_data_usage,fee_data_usage_description,uri_data_usage,restrictions_apply,restrictions_description,uri_policy_network_management,uri_policy_privacy,uri_customer_support
-2025-01-15,FCC,1,fixed,0005937974,F0005937974TIER1,50,Xfinity Internet,Extreme 500,Mbps,2,2,2,2,Mbps,2,2,2,2,2,2,USD,Pre-Paid,Requires activation of one new device.,100,10.32,only for new customers,No,Contract is 1 year.,https://example.com/contract-terms/internet/,29,Professional installation fee of $100 required.,," Monthly device rental."," $12.99"," Emergency services cost recovery fee",0," $100 charged if service is terminated before the end of one year.",Included,Yes,,,https://example.com/data-usage/internet/,Yes,Site survey required,https://example.com/network-management/internet/,https://example.com/privacy/internet/,https://example.com/support.html
-2025-11-02,,1,mobile,0003768165,F0005937974ABCD12341234,500,T-Mobile,Turbo 5G Plus,Mbps,75,75,75,75,Mbps,75,75,75,75,75,75,USD,Post-Paid,Price covers first 1 GB of data transferred. Data transfer billed at $1 per GB thereafter.,100,10.32,only for new customers,No,Valid for first 3 months.,https://example.com/internet-contract/,29.99,Shipping fee of $20 for sending equipment.,9,Cloud storage fee.,$10,State regulatory assessment fee,100,$25,Varies,Yes,1,$1 per GB after the first 1 TB.,https://example.com/datausagepolicies,Yes,Qualified for a low-income offering,https://example.com/networkpolicies,https://example.com/privacy-policies/,https://example.com/support/internet/
+date_published,regulator_name,regulator_version_number,connection_type,fcc_registration_number,unique_plan_identifier,network_technology_type,provider_name,service_plan_name,bandwidth_download_units,bandwidth_download_marketed_low,bandwidth_download_marketed_high,bandwidth_download_typical_low,bandwidth_download_typical_high,bandwidth_upload_units,bandwidth_upload_marketed_low,bandwidth_upload_marketed_high,bandwidth_upload_typical_low,bandwidth_upload_typical_high,latency_idle_low,latency_idle_high,currency,price_type,price_details,price_recurring,fee_introductory,fee_introductory_description,contract_required,contract_details,contract_terms_uri,fee_one_time_amount,fee_one_time_details,fee_recurring,fee_recurring_description,fee_pass_through_recurring,fee_pass_through_recurring_description,fee_early_termination,fee_early_termination_description,government_taxes,policy_data_usage,fee_data_usage,fee_data_usage_description,uri_data_usage,restrictions_apply,restrictions_description,uri_policy_network_management,uri_policy_privacy,uri_customer_support,customer_support_phone
+2025-01-15,FCC,1,fixed,0005937974,F0005937974TIER1,50,Xfinity Internet,Extreme 500,Mbps,2,2,2,2,Mbps,2,2,2,2,2,2,USD,Pre-Paid,Requires activation of one new device.,100,10.32,only for new customers,No,Contract is 1 year.,https://example.com/contract-terms/internet/,29,Professional installation fee of $100 required.,," Monthly device rental."," $12.99"," Emergency services cost recovery fee",0," $100 charged if service is terminated before the end of one year.",Included,Yes,,,https://example.com/data-usage/internet/,Yes,Site survey required,https://example.com/network-management/internet/,https://example.com/privacy/internet/,https://example.com/support.html,18005551212
+2025-11-02,,1,mobile,0003768165,F0005937974ABCD12341234,500,T-Mobile,Turbo 5G Plus,Mbps,75,75,75,75,Mbps,75,75,75,75,75,75,USD,Post-Paid,Price covers first 1 GB of data transferred. Data transfer billed at $1 per GB thereafter.,100,10.32,only for new customers,No,Valid for first 3 months.,https://example.com/internet-contract/,29.99,Shipping fee of $20 for sending equipment.,9,Cloud storage fee.,$10,State regulatory assessment fee,100,$25,Varies,Yes,1,$1 per GB after the first 1 TB.,https://example.com/datausagepolicies,Yes,Qualified for a low-income offering,https://example.com/networkpolicies,https://example.com/privacy-policies/,https://example.com/support/internet/,18885551212
 2025-06-06,FCC,99,satellite,0005937974,F0005937974ABCDEFGHIJ12345,500,Google Fiber,Fiber 2G,Gbps,500,500,500,500,Gbps,500,500,500,500,500,500,USD,Volume-Based,For new customers only.,100,10.32,only for new customers,Yes,"Contract must be digitally signed within 7 days of
 installation.",https://example.com/legal/terms/contracts.html,399.00,"$10
 device provisioning fee.
@@ -9,5 +9,5 @@ Street USA;Local franchise fee for Gotham City
 ",9.99,"$10 for every month
 remaining in contract term.",Not Applicable,No,,"No fee but bitrates are reduced to 100 Mbps after 10 GB of
 usage.",https://example.com/data-usage.html,No,"Mobile service only available to existing
-customers of wireline service",https://example.com/network-management.html,https://example.com/privacypolicy.html,https://example.com/support
-2025-06-06,FCC,,something,,,0,randomeValue,,kbps,1,1,1,1,kbps,1,1,1,1,1,1,USD,Other,Requires activation of one new device.,100,10.32,only for new customers,No,,,,,12.99,,,,0,,Included,No,143.32,$2 per GB during peak times and $1 per GB during off-peak times.,,Yes,,,,
+customers of wireline service",https://example.com/network-management.html,https://example.com/privacypolicy.html,https://example.com/support,"12675551212"
+2025-06-06,FCC,,something,,,0,randomeValue,,kbps,1,1,1,1,kbps,1,1,1,1,1,1,USD,Other,Requires activation of one new device.,100,10.32,only for new customers,No,,,,,12.99,,,,0,,Included,No,143.32,$2 per GB during peak times and $1 per GB during off-peak times.,,Yes,,,,,

src/main/resources/schemas/schema.csvs

@@ -1,5 +1,5 @@
 version 1.1
-@totalColumns 48
+@totalColumns 49
 date_published: xDate
 regulator_name: empty or upperCase
 regulator_version_number: empty or range(1, 99)
@@ -48,3 +48,4 @@ restrictions_description: empty or length(0, 500)
 uri_policy_network_management: empty or uri
 uri_policy_privacy: empty or uri
 uri_customer_support: empty or uri
+customer_support_phone: empty or regex("^[0-9]{7,15}$") // TODO: min length for phone number is 7

src/main/resources/schemas/schema_specs

@@ -527,4 +527,18 @@ This is the URI containing information about how to obtain customer support for
 This field MUST be in the file and MAY be populated. If it does not apply, it SHOULD be left empty.
 Name: uri_customer_support
 Type/Format: identifier, uri
-Examples: https://example.com/support/internet/, https://example.com/support, https://example.com/support.html
+Examples: https://example.com/support/internet/, https://example.com/support, https://example.com/support.html
+
+
+49. Customer Support Phone Number.
+This is the telephone number a customer can use to contact customer support. The field MUST use the full
+International Telecommunications Union (ITU), Telecommunication Standardization Sector (ITU-T) E.164-
+format telephone number, including the country code. [45] It MUST contain only numbers; no parenthesis
+marks, hyphens, periods, or other delimiting marks are permissible. For example, while a North American
+number may be represented variously as +1-800-555-1212, 1-800-555-1212, 1 (800) 555-1212, 1.800.555.1212,
+or other format, this field MUST NOT contain non-numeric characters. If no customer support phone number
+is provided, this field MAY be left empty.
+This field MUST be in the file and MAY be populated. If it does not apply, it SHOULD be left empty.
+Name: customer_support_phone
+Type: numeric, length(*,15)
+Examples: 18005551212, 18885551212, 12675551212