fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! fixup! [feature] Introduce the bitag bbl schema

Author: marmoure

src/main/resources/schemas/sample.csv

@@ -1,6 +1,6 @@
-date_published,regulator_name,regulator_version_number,connection_type,fcc_registration_number,unique_plan_identifier,network_technology_type,provider_name,service_plan_name,bandwidth_download_units,bandwidth_download_marketed_low,bandwidth_download_marketed_high,bandwidth_download_typical_low,bandwidth_download_typical_high,bandwidth_upload_units,bandwidth_upload_marketed_low,bandwidth_upload_marketed_high,bandwidth_upload_typical_low,bandwidth_upload_typical_high,latency_idle_low,latency_idle_high,currency,price_type,price_details,price_recurring,fee_introductory,fee_introductory_description,contract_required,contract_details,contract_terms_uri,fee_one_time_amount,fee_one_time_details,fee_recurring,fee_recurring_description,fee_pass_through_recurring,fee_pass_through_recurring_description,fee_early_termination,fee_early_termination_description,government_taxes,policy_data_usage,fee_data_usage,fee_data_usage_description,uri_data_usage,restrictions_apply,restrictions_description
-2025-01-15,FCC,1,fixed,0005937974,F0005937974TIER1,50,Xfinity Internet,Extreme 500,Mbps,2,2,2,2,Mbps,2,2,2,2,2,2,USD,Pre-Paid,Requires activation of one new device.,100,10.32,only for new customers,No,Contract is 1 year.,https://example.com/contract-terms/internet/,29,Professional installation fee of $100 required.,," Monthly device rental."," $12.99"," Emergency services cost recovery fee",0," $100 charged if service is terminated before the end of one year.",Included,Yes,,,https://example.com/data-usage/internet/,Yes,Site survey required
-2025-11-02,,1,mobile,0003768165,F0005937974ABCD12341234,500,T-Mobile,Turbo 5G Plus,Mbps,75,75,75,75,Mbps,75,75,75,75,75,75,USD,Post-Paid,Price covers first 1 GB of data transferred. Data transfer billed at $1 per GB thereafter.,100,10.32,only for new customers,No,Valid for first 3 months.,https://example.com/internet-contract/,29.99,Shipping fee of $20 for sending equipment.,9,Cloud storage fee.,$10,State regulatory assessment fee,100,$25,Varies,Yes,1,$1 per GB after the first 1 TB.,https://example.com/datausagepolicies,Yes,Qualified for a low-income offering
+date_published,regulator_name,regulator_version_number,connection_type,fcc_registration_number,unique_plan_identifier,network_technology_type,provider_name,service_plan_name,bandwidth_download_units,bandwidth_download_marketed_low,bandwidth_download_marketed_high,bandwidth_download_typical_low,bandwidth_download_typical_high,bandwidth_upload_units,bandwidth_upload_marketed_low,bandwidth_upload_marketed_high,bandwidth_upload_typical_low,bandwidth_upload_typical_high,latency_idle_low,latency_idle_high,currency,price_type,price_details,price_recurring,fee_introductory,fee_introductory_description,contract_required,contract_details,contract_terms_uri,fee_one_time_amount,fee_one_time_details,fee_recurring,fee_recurring_description,fee_pass_through_recurring,fee_pass_through_recurring_description,fee_early_termination,fee_early_termination_description,government_taxes,policy_data_usage,fee_data_usage,fee_data_usage_description,uri_data_usage,restrictions_apply,restrictions_description,uri_policy_network_management,uri_policy_privacy,uri_customer_support
+2025-01-15,FCC,1,fixed,0005937974,F0005937974TIER1,50,Xfinity Internet,Extreme 500,Mbps,2,2,2,2,Mbps,2,2,2,2,2,2,USD,Pre-Paid,Requires activation of one new device.,100,10.32,only for new customers,No,Contract is 1 year.,https://example.com/contract-terms/internet/,29,Professional installation fee of $100 required.,," Monthly device rental."," $12.99"," Emergency services cost recovery fee",0," $100 charged if service is terminated before the end of one year.",Included,Yes,,,https://example.com/data-usage/internet/,Yes,Site survey required,https://example.com/network-management/internet/,https://example.com/privacy/internet/,https://example.com/support.html
+2025-11-02,,1,mobile,0003768165,F0005937974ABCD12341234,500,T-Mobile,Turbo 5G Plus,Mbps,75,75,75,75,Mbps,75,75,75,75,75,75,USD,Post-Paid,Price covers first 1 GB of data transferred. Data transfer billed at $1 per GB thereafter.,100,10.32,only for new customers,No,Valid for first 3 months.,https://example.com/internet-contract/,29.99,Shipping fee of $20 for sending equipment.,9,Cloud storage fee.,$10,State regulatory assessment fee,100,$25,Varies,Yes,1,$1 per GB after the first 1 TB.,https://example.com/datausagepolicies,Yes,Qualified for a low-income offering,https://example.com/networkpolicies,https://example.com/privacy-policies/,https://example.com/support/internet/
 2025-06-06,FCC,99,satellite,0005937974,F0005937974ABCDEFGHIJ12345,500,Google Fiber,Fiber 2G,Gbps,500,500,500,500,Gbps,500,500,500,500,500,500,USD,Volume-Based,For new customers only.,100,10.32,only for new customers,Yes,"Contract must be digitally signed within 7 days of
 installation.",https://example.com/legal/terms/contracts.html,399.00,"$10
 device provisioning fee.
@@ -9,5 +9,5 @@ Street USA;Local franchise fee for Gotham City
 ",9.99,"$10 for every month
 remaining in contract term.",Not Applicable,No,,"No fee but bitrates are reduced to 100 Mbps after 10 GB of
 usage.",https://example.com/data-usage.html,No,"Mobile service only available to existing
-customers of wireline service"
-2025-06-06,FCC,,something,,,0,randomeValue,,kbps,1,1,1,1,kbps,1,1,1,1,1,1,USD,Other,Requires activation of one new device.,100,10.32,only for new customers,No,,,,,12.99,,,,0,,Included,No,143.32,$2 per GB during peak times and $1 per GB during off-peak times.,,Yes,
+customers of wireline service",https://example.com/network-management.html,https://example.com/privacypolicy.html,https://example.com/support
+2025-06-06,FCC,,something,,,0,randomeValue,,kbps,1,1,1,1,kbps,1,1,1,1,1,1,USD,Other,Requires activation of one new device.,100,10.32,only for new customers,No,,,,,12.99,,,,0,,Included,No,143.32,$2 per GB during peak times and $1 per GB during off-peak times.,,Yes,,,,

src/main/resources/schemas/schema.csvs

@@ -1,5 +1,5 @@
 version 1.1
-@totalColumns 45
+@totalColumns 48
 date_published: xDate
 regulator_name: empty or upperCase
 regulator_version_number: empty or range(1, 99)
@@ -45,3 +45,6 @@ fee_data_usage_description: empty or length(0, 500)
 uri_data_usage: empty or uri
 restrictions_apply: any("Yes", "No")
 restrictions_description: empty or length(0, 500)
+uri_policy_network_management: empty or uri
+uri_policy_privacy: empty or uri
+uri_customer_support: empty or uri

src/main/resources/schemas/schema_specs

@@ -505,3 +505,26 @@ Name: restrictions_description
 Type/Format: string
 Examples: Site survey required, Qualified for a low-income offering, Mobile service only available to existing
 customers of wireline service
+
+46. Network Management Policy Uniform Resource Indicator (URI).
+This is the URI for a network management policy that may apply to a specific BIAS offering.
+This field MUST be in the file and MAY be populated. If it does not apply, it SHOULD be left empty.
+Name: uri_policy_network_management
+Type/Format: identifier, uri
+Examples: https://example.com/network-management/internet/, https://example.com/networkpolicies,
+https://example.com/network-management.html
+
+47. Privacy Policy Uniform Resource Indicator (URI).
+This is the URI for a privacy policy that may apply to a specific BIAS offering.
+This field MUST be in the file and MAY be populated. If it does not apply, it SHOULD be left empty.
+Name: uri_policy_privacy
+Type/Format: identifier, uri
+Examples: https://example.com/privacy/internet/, https://example.com/privacy-policies/, https://example.com/privacypolicy
+
+
+48. Customer Support Information Uniform Resource Indicator (URI).
+This is the URI containing information about how to obtain customer support for a specific BIAS offering.
+This field MUST be in the file and MAY be populated. If it does not apply, it SHOULD be left empty.
+Name: uri_customer_support
+Type/Format: identifier, uri
+Examples: https://example.com/support/internet/, https://example.com/support, https://example.com/support.html