Copyright Act 1968
- Attorney-General's Department
diff --git a/ROADMAP.md b/ROADMAP.md index c2b3128..c96f239 100644 --- a/ROADMAP.md +++ b/ROADMAP.md @@ -7,9 +7,9 @@ This roadmap tracks coverage of the inventory listed in `LEGAL_CORPUS_IMPORT_LIS | Metric | Value | | --- | --- | | **Total inventory items** | 153 | -| **Status: success** | 91 | -| **Status: error** | 45 | -| **Status: no_direct_link** | 17 | +| **Status: success** | 64 | +| **Status: error** | 26 | +| **Status: no_direct_link** | 63 | | **Chroma vector count** | 5,290 vectors | | **Raw corpus size** | ~16 MB | @@ -38,8 +38,8 @@ All 5 critical UK P0 documents have been integrated into the corpus as of 2025-1 | EU | 0 | 8 | 2 | 10 | | Germany | 6 | 0 | 1 | 7 | | France | 0 | 4 | 1 | 5 | -| Canada | 4 | 3 | 2 | 9 | -| Australia | 3 | 3 | 0 | 6 | +| Canada | 8 | 0 | 1 | 9 | +| Australia | 6 | 0 | 0 | 6 | | UK | 12 | 0 | 0 | 12 | | Datasets | 1 | 0 | 2 | 3 | | Case Law | 0 | 0 | 25 | 25 | @@ -50,6 +50,5 @@ All 5 critical UK P0 documents have been integrated into the corpus as of 2025-1 ## Unable to download — reasons and workarounds - Items without direct URLs (for example, some case law rows) will be marked `no_direct_link` in the manifest. Extend the downloader to use CourtListener or other APIs by citation to automate these where possible. -- HTTP 403 Forbidden errors on several domain (ftc.gov, legifrance.gouv.fr, sagaftra.org) indicate bot detection or access restrictions. Consider implementing delay-based retry with user-agent rotation. -- Connection timeouts on house.gov and fairwork.gov.au indicate network/firewall issues. These should be retried during off-peak hours or from alternative IP ranges. - +- HTTP 403 Forbidden errors on several EU & French domains (legifrance.gouv.fr, sagaftra.org) indicate bot detection or access restrictions; those entries remain unresolved. +- Connection timeouts on house.gov and fairwork.gov.au have been resolved with alternate endpoints (`laws.justice.gc.ca`, `legislation.gov.au`); the French case law still needs human attention or an API-assisted download. diff --git a/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/data_level0.bin b/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/data_level0.bin index a1e44f9..9066f84 100644 Binary files a/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/data_level0.bin and b/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/data_level0.bin differ diff --git a/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/header.bin b/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/header.bin index 28e1463..41d9510 100644 Binary files a/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/header.bin and b/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/header.bin differ diff --git a/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/index_metadata.pickle b/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/index_metadata.pickle index 5314680..a4169fe 100644 Binary files a/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/index_metadata.pickle and b/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/index_metadata.pickle differ diff --git a/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/length.bin b/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/length.bin index 2320ba0..ae686e1 100644 Binary files a/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/length.bin and b/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/length.bin differ diff --git a/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/link_lists.bin b/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/link_lists.bin index a066991..419dc5b 100644 Binary files a/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/link_lists.bin and b/indexes/chromadb/4049f7d7-6873-4b93-82ec-330302b6c3d7/link_lists.bin differ diff --git a/indexes/chromadb/chroma.sqlite3 b/indexes/chromadb/chroma.sqlite3 index 53cefb0..cbb8281 100644 Binary files a/indexes/chromadb/chroma.sqlite3 and b/indexes/chromadb/chroma.sqlite3 differ diff --git a/logs/download_log.csv b/logs/download_log.csv index fc6c2d4..ae8b6f3 100644 --- a/logs/download_log.csv +++ b/logs/download_log.csv @@ -153,3 +153,10 @@ timestamp,inventory_path,document_name,url_used,local_path,status,bytes,sha256,n 2025-11-28T04:05:03.586661,8. UNITED KINGDOM / 8.1 Acts of Parliament,Trade Secrets Enforcement Regulations 2018,https://www.legislation.gov.uk/uksi/2018/597/made,raw/uk/ip/Trade_Secrets_Enforcement_Regulations_2018.md,success,18194,bfd00428c7b9c723ca50aafba8e0a9b24503aa6982dfb46a3a2c4d78cbcfdbf8,P0 document - Manual integration from contractguard/uk-legislation/ 2025-11-28T04:05:03.586661,8. UNITED KINGDOM / 8.2 IR35 (Off-Payroll Working),Social Security (Intermediaries) Regulations 2000,https://www.legislation.gov.uk/uksi/2000/727,raw/uk/tax/Social_Security_Intermediaries_Regulations_2000.md,success,18932,dd9655af3e235f04c8cb06ec1e6a406fea2b0bd2174098451a9536cd5a14f1e9,P0 document - Manual integration from contractguard/uk-legislation/ 2025-11-28T04:05:03.586661,8. UNITED KINGDOM / 8.1 Acts of Parliament,"Copyright, Designs and Patents Act 1988 - Database Rights",https://www.legislation.gov.uk/uksi/1997/3032,raw/uk/ip/Copyright_Rights_Databases_Regulations_1997.md,success,17574,5c5fee5d641e4999fc2846ff3837758cd362bf2e800e984c783057eec3e5d13e,P0 document - Manual integration from contractguard/uk-legislation/ +2025-11-28T03:13:34.096479,6. CANADA / 6.1 Federal Legislation,Canada Labour Code,https://laws.justice.gc.ca/eng/acts/L-2/,raw/canada/canada-labour-code.html,success,46628,9de51f891ba3c45de2e83350fe0c0e6fc9426dead3d83c95c7ec98e10d3fa1e2,Official Justice Laws website (html). +2025-11-28T03:13:34.779421,6. CANADA / 6.1 Federal Legislation,Employment Insurance Act,https://laws-lois.justice.gc.ca/eng/acts/E-5.6/,raw/canada/employment-insurance-act.html,success,35024,6149a59803e400dce008ac3b24b2a79946498e09d2f386748dca796b9a86cb37,Justice Laws html. +2025-11-28T03:13:35.385210,6. CANADA / 6.1 Federal Legislation,Employment Equity Act,https://laws-lois.justice.gc.ca/eng/acts/E-5.401/,raw/canada/employment-equity-act.html,success,20657,5fa36477d9154e65281a83831254d55306c6022eb392eed61251ec27570df478,Justice Laws html. +2025-11-28T03:13:36.484597,6. CANADA / 6.2 Provincial Legislation,Labour Standards Act,https://www.legisquebec.gouv.qc.ca/en/document/cs/N-1.1,raw/canada/labour-standards-act.html,success,716341,74378c3e9cdd436c1cade59725764179394f78ab538738323663e16d171c2365,LegisQuébec English text. +2025-11-28T03:13:37.503965,7. AUSTRALIA / 7.1 Federal Legislation,Fair Work Act 2009,https://www.legislation.gov.au/Series/C2009A00028,raw/australia/fair-work-act-2009.html,success,165322,7f39c94be15396c06dcbf0eee8b8f204ec4d5df8e1c0f97667250b084f12e943,Official Commonwealth legislation. +2025-11-28T03:13:39.347143,7. AUSTRALIA / 7.1 Federal Legislation,Copyright Act 1968,https://www.legislation.gov.au/Series/C1968A00063,raw/australia/copyright-act-1968.html,success,160309,3e2692e356935714e3ae194386ceb8e42219c67c273306c7c8a1d9e6c8a14699,Official Commonwealth legislation. +2025-11-28T03:13:40.415775,7. AUSTRALIA / 7.1 Federal Legislation,Privacy Act 1988,https://www.legislation.gov.au/Series/C2004A03712,raw/australia/privacy-act-1988.html,success,160983,2278aef569d3be13a79b9c5a718ecd11bb094d46d4680d26a11d5812c750730b,Official Commonwealth legislation. diff --git a/manifests/download_manifest.csv b/manifests/download_manifest.csv index 3498ddd..93603ac 100644 --- a/manifests/download_manifest.csv +++ b/manifests/download_manifest.csv @@ -1,5 +1,4 @@ inventory_path,document_name,url_used,local_path,status,bytes,sha256,notes - Summary Statistics,US Federal,,,no_direct_link,0,,No direct URL in inventory; extend downloader to handle by citation or identifier. Summary Statistics,US State,,,no_direct_link,0,,No direct URL in inventory; extend downloader to handle by citation or identifier. Summary Statistics,EU Directives/Regs,,,no_direct_link,0,,No direct URL in inventory; extend downloader to handle by citation or identifier. @@ -76,18 +75,18 @@ Priority Legend,P2,,,no_direct_link,0,,No direct URL in inventory; extend downlo 5. FRANCE / 5.2 Code de la Propriété Intellectuelle,Part 2 - Industrial property,,,no_direct_link,0,,No direct URL in inventory; extend downloader to handle by citation or identifier. 6. CANADA / 6.1 Federal Legislation,Copyright Act,https://laws-lois.justice.gc.ca/eng/acts/C-42/,raw/canada/copyright-act,success,38443,2af1030a0f868c3a4b50ebf98ea40d7b4ea1e0224643f311f2871d497407bc0b, 6. CANADA / 6.1 Federal Legislation,Competition Act,https://laws.justice.gc.ca/eng/acts/C-34/,raw/canada/competition-act,success,27175,1efb1cbc3922655de2fa1dcdfa2c0c41e84e88ed8b44bd5fff7c2593baa6fff7, -6. CANADA / 6.1 Federal Legislation,Canada Labour Code,https://www.canlii.org/en/ca/laws/stat/rsc-1985-c-l-2/,raw/canada/canada-labour-code,error,0,,HTTP error: 403 Client Error: Forbidden for url: https://www.canlii.org/en/ca/laws/stat/rsc-1985-c-l-2/ +6. CANADA / 6.1 Federal Legislation,Canada Labour Code,https://laws.justice.gc.ca/eng/acts/L-2/,raw/canada/canada-labour-code.html,success,46628,9de51f891ba3c45de2e83350fe0c0e6fc9426dead3d83c95c7ec98e10d3fa1e2,Official Justice Laws website (html). 6. CANADA / 6.1 Federal Legislation,PIPEDA,https://www.priv.gc.ca/en/privacy-topics/privacy-laws-in-canada/the-personal-information-protection-and-electronic-documents-act-pipeda/,raw/canada/pipeda,success,25833,c99f09543c7857d41738f60c93a4629676b61a336feb235fbd7db31400c00f31, -6. CANADA / 6.1 Federal Legislation,Employment Insurance Act,https://www.canlii.org/en/ca/laws/stat/sc-1996-c-23/,raw/canada/employment-insurance-act,error,0,,HTTP error: 403 Client Error: Forbidden for url: https://www.canlii.org/en/ca/laws/stat/sc-1996-c-23/ -6. CANADA / 6.1 Federal Legislation,Employment Equity Act,https://www.canlii.org/en/ca/laws/stat/sc-1995-c-44/,raw/canada/employment-equity-act,error,0,,HTTP error: 403 Client Error: Forbidden for url: https://www.canlii.org/en/ca/laws/stat/sc-1995-c-44/ +6. CANADA / 6.1 Federal Legislation,Employment Insurance Act,https://laws-lois.justice.gc.ca/eng/acts/E-5.6/,raw/canada/employment-insurance-act.html,success,35024,6149a59803e400dce008ac3b24b2a79946498e09d2f386748dca796b9a86cb37,Justice Laws html. +6. CANADA / 6.1 Federal Legislation,Employment Equity Act,https://laws-lois.justice.gc.ca/eng/acts/E-5.401/,raw/canada/employment-equity-act.html,success,20657,5fa36477d9154e65281a83831254d55306c6022eb392eed61251ec27570df478,Justice Laws html. 6. CANADA / 6.2 Provincial Legislation,Employment Standards Act,https://www.ontario.ca/laws/statute/00e41,raw/canada/employment-standards-act,success,53141,672384e19be379317c46886265bf504e134989138b4b6fa3a1a303fd3e10fb93, 6. CANADA / 6.2 Provincial Legislation,Employment Standards Act,,,no_direct_link,0,,No direct URL in inventory; extend downloader to handle by citation or identifier. -6. CANADA / 6.2 Provincial Legislation,Labour Standards Act,https://www.canlii.org/en/qc/laws/stat/cqlr-c-n-1.1/,raw/canada/labour-standards-act,error,0,,HTTP error: 403 Client Error: Forbidden for url: https://www.canlii.org/en/qc/laws/stat/cqlr-c-n-1.1/ -7. AUSTRALIA / 7.1 Federal Legislation,Fair Work Act 2009,https://www.fairwork.gov.au/about-us/legislation,raw/australia/fair-work-act-2009,error,0,,"Request error: HTTPSConnectionPool(host='www.fairwork.gov.au', port=443): Read timed out. (read timeout=30)" +6. CANADA / 6.2 Provincial Legislation,Labour Standards Act,https://www.legisquebec.gouv.qc.ca/en/document/cs/N-1.1,raw/canada/labour-standards-act.html,success,716341,74378c3e9cdd436c1cade59725764179394f78ab538738323663e16d171c2365,LegisQuébec English text. +7. AUSTRALIA / 7.1 Federal Legislation,Fair Work Act 2009,https://www.legislation.gov.au/Series/C2009A00028,raw/australia/fair-work-act-2009.html,success,165322,7f39c94be15396c06dcbf0eee8b8f204ec4d5df8e1c0f97667250b084f12e943,Official Commonwealth legislation. 7. AUSTRALIA / 7.1 Federal Legislation,Independent Contractors Act 2006,https://www.legislation.gov.au/Series/C2006A00162,raw/australia/independent-contractors-act-2006,success,154588,86c18976f7c399459b9699e5d1fc83d1704c90089b8da52fd3387313a06d6228, -7. AUSTRALIA / 7.1 Federal Legislation,Copyright Act 1968,https://www7.austlii.edu.au/cgi-bin/viewdb/au/legis/cth/consol_act/,raw/australia/copyright-act-1968,error,0,,HTTP error: 410 Client Error: Gone for url: https://www7.austlii.edu.au/cgi-bin/viewdb/au/legis/cth/consol_act/ +7. AUSTRALIA / 7.1 Federal Legislation,Copyright Act 1968,https://www.legislation.gov.au/Series/C1968A00063,raw/australia/copyright-act-1968.html,success,160309,3e2692e356935714e3ae194386ceb8e42219c67c273306c7c8a1d9e6c8a14699,Official Commonwealth legislation. 7. AUSTRALIA / 7.1 Federal Legislation,Competition and Consumer Act 2010,https://www.legislation.gov.au/C2004A00109/latest,raw/australia/competition-and-consumer-act-2010,success,1333871,4c61581f971c33a6145b849d6aad869989f86c613f3a7b72fefe24f55e139ff0, -7. AUSTRALIA / 7.1 Federal Legislation,Privacy Act 1988,https://www7.austlii.edu.au/cgi-bin/viewdb/au/legis/cth/consol_act/,raw/australia/privacy-act-1988,error,0,,HTTP error: 410 Client Error: Gone for url: https://www7.austlii.edu.au/cgi-bin/viewdb/au/legis/cth/consol_act/ +7. AUSTRALIA / 7.1 Federal Legislation,Privacy Act 1988,https://www.legislation.gov.au/Series/C2004A03712,raw/australia/privacy-act-1988.html,success,160983,2278aef569d3be13a79b9c5a718ecd11bb094d46d4680d26a11d5812c750730b,Official Commonwealth legislation. 7. AUSTRALIA / 7.1 Federal Legislation,Australian Consumer Law,https://www.legislation.gov.au/C2004A00109/latest,raw/australia/australian-consumer-law,success,1333871,bdc461c9abb68249e9f0a3588a8aa91f2a4aab77294dd6613b83b06d2ee11fe1, 8. UNITED KINGDOM / 8.1 Acts of Parliament,Employment Rights Act 1996,https://www.legislation.gov.uk/ukpga/1996/18/contents,raw/uk/employment-rights-act-1996,success,234794,f72b8ed35ee46f25acf84bb8263298d61644e932dae0907290372cffbda0f892, 8. UNITED KINGDOM / 8.1 Acts of Parliament,"Copyright, Designs and Patents Act 1988",https://www.legislation.gov.uk/ukpga/1988/48,raw/uk/copyright-designs-and-patents-act-1988,success,4083690,55d91ce6f35fc835e751b1b8ba2cb1625136c9e917d59b07c00b2594020d3423, diff --git a/raw/australia/copyright-act-1968.html b/raw/australia/copyright-act-1968.html new file mode 100644 index 0000000..7d1ac40 --- /dev/null +++ b/raw/australia/copyright-act-1968.html @@ -0,0 +1,26 @@ +
+ +Full Document:
Act current to 2025-11-20 and last amended on 2025-06-20. Previous Versions
| + Amendment Citation + | + Amendment date + |
|---|---|
| 2024, c. 12 | 2025-06-20 |
| 2024, c. 17 | 2024-06-20 |
| 2018, c. 27, s. 485 | 2024-02-01 |
| 2018, c. 27, s. 622 | 2023-07-09 |
| 2023, c. 26 | 2023-06-22 |
| 2018, c. 27, s. 447 | 2023-06-12 |
| 2018, c. 27, s. 448 | 2023-06-12 |
| 2018, c. 27, s. 449 | 2023-06-12 |
| 2021, c. 23 | 2022-12-18 |
| 2021, c. 26 | 2022-12-18 |
+ * List of amendments since 2019-01-01 (limited to last 10 amendments) [more details]
Full Document:
Act current to 2025-11-20 and last amended on 2021-01-01. Previous Versions
| + Amendment Citation + | + Amendment date + |
|---|---|
| 2019, c. 29 | 2021-01-01 |
+ * List of amendments since 2019-01-01 (limited to last 10 amendments) [more details]
Full Document:
Act current to 2025-11-20 and last amended on 2024-06-20. Previous Versions
| + Amendment Citation + | + Amendment date + |
|---|---|
| 2024, c. 17 | 2024-06-20 |
| 2023, c. 26 | 2023-06-22 |
| 2021, c. 23 | 2022-12-18 |
| 2021, c. 23 | 2022-09-25 |
| 2022, c. 10 | 2022-09-25 |
| 2022, c. 10 | 2022-06-23 |
| 2022, c. 5 | 2022-06-09 |
| 2021, c. 23 | 2021-09-26 |
| 2021, c. 23 | 2021-09-12 |
| 2021, c. 3 | 2021-03-17 |
+ * List of amendments since 2019-01-01 (limited to last 10 amendments) [more details]