Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Non-RDS Hash Sets

On this page, we will make links available to data sets that use hashing or digest algorithms not contained in the RDS release. If there is an algorithm or process that you think would be interesting to run on the NSRL file corpus files found in the RDS (or on a subset of files), please contact nsrl [at] nist.gov (subject: , body: ) (nsrl[at]nist[dot]gov) .

NOTE: These downloads are being served from the amazon cloud. You may receive a notice that you are leaving the NSRL website.


Child Abuse Image Database (CAID) sets

The NSRL publishes JSON format sets of metadata about multimedia files which can be imported into CAID tools.

The current delta updates to the NIST NSRL CAID JSON are available for download with hash signatures at: 
RDS/CAID/current/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/current/NSRL-CAID-JSONs.zip

The current full set of the NIST NSRL CAID JSON are available for download with hash signatures at: 
RDS/CAID/current/NSRL-CAID-JSONs-full-2024.03.1.zip.sha 
RDS/CAID/current/NSRL-CAID-JSONs-full-2024.03.1.zip

The current NIST NSRL CAID JSON release includes the complete set of files, while the delta release contains new files added since the previous NIST NSRL CAID JSON release. The following table represents the total number of files of each multimedia type in the current full release: 

1,240NSRL-CAID-3GP.json
4,041NSRL-CAID-ART.json
16,025NSRL-CAID-AVI.json
435,208NSRL-CAID-BMP.json
10NSRL-CAID-DNG.json
3,826NSRL-CAID-EMF.json
3,924NSRL-CAID-FLV.json
3,199,200NSRL-CAID-GIF.json
7,403NSRL-CAID-JP2.json
4,069,322NSRL-CAID-JPG.json
42,657NSRL-CAID-MOV.json
3,051NSRL-CAID-MPG.json
22,589,480NSRL-CAID-PNG.json
11,071NSRL-CAID-PSD.json
215,579NSRL-CAID-TIF.json
646,335NSRL-CAID-WAV.json
617,121NSRL-CAID-WMF.json
6,075NSRL-CAID-WMV.json
31,871,568Total

Previous releases are available at:

RDS/CAID/20240301/NSRL-CAID-JSONs.zip.sha
RDS/CAID/20240301/NSRL-CAID-JSONs.zip

RDS/CAID/20240301-full/NSRL-CAID-JSONs-full-2024.03.1.zip.sha
RDS/CAID/20240301-full/NSRL-CAID-JSONs-full-2024.03.1.zip

RDS/CAID/20231127/NSRL-CAID-JSONs.zip.sha
RDS/CAID/20231127/NSRL-CAID-JSONs.zip

RDS/CAID/20230828/NSRL-CAID-JSONs.zip.sha
RDS/CAID/20230828/NSRL-CAID-JSONs.zip

RDS/CAID/20230601/NSRL-CAID-JSONs.zip.sha
RDS/CAID/20230601/NSRL-CAID-JSONs.zip

RDS/CAID/20230301/NSRL-CAID-JSONs.zip.sha
RDS/CAID/20230301/NSRL-CAID-JSONs.zip

RDS/CAID/20221201/NSRL-CAID-JSONs.zip.sha
RDS/CAID/20221201/NSRL-CAID-JSONs.zip

RDS/CAID/20220830/NSRL-CAID-JSONs.zip.sha
RDS/CAID/20220830/NSRL-CAID-JSONs.zip

RDS/CAID/20220526/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/20220526/NSRL-CAID-JSONs.zip 

RDS/CAID/20220309/NSRL-CAID-JSONs.zip.sha
RDS/CAID/20220309/NSRL-CAID-JSONs.zip

RDS/CAID/20220301/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/20220301/NSRL-CAID-JSONs.zip 

RDS/CAID/20211124/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/20211124/NSRL-CAID-JSONs.zip

RDS/CAID/20210826/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/20210826/NSRL-CAID-JSONs.zip

RDS/CAID/20210603/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/20210603/NSRL-CAID-JSONs.zip

RDS/CAID/20210301/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/20210301/NSRL-CAID-JSONs.zip

RDS/CAID/20201202/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/20201202/NSRL-CAID-JSONs.zip

RDS/CAID/20200902/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/20200902/NSRL-CAID-JSONs.zip

RDS/CAID/20200601/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/20200601/NSRL-CAID-JSONs.zip

RDS/CAID/20200310/NSRL-CAID-JSONs.zip.sha 
RDS/CAID/20200310/NSRL-CAID-JSONs.zip

RDS/CAID/20191009/NSRL-CAID-JSONs.zip

RDS/CAID/20190614/NSRL-CAID-JSONs.zip

RDS/CAID/20181121/NSRL-CAID-JSONs.zip

RDS/CAID/20180601/NSRL-CAID-JSONs.zip

RDS/CAID/20180208/NSRL-CAID-JSONs.zip

SHA1 toSHA 256

A text file which relates SHA-1 to SHA-256 hashes is available.
A 1.1 GB Zip file can be downloaded which contains a 1.9 GB text file with 16,801,737 rows.
Each row has a SHA-1 hash, a tab character, a SHA-256 hash, a tab and a filename. An example of the data can be found here.

The SHA-1 values can be matched to SHA-1 values in RDS 2.41. Note: not all SHA-1 values in RDS 2.41 can be matched to SHA-256 values.

File signatures:
SHA1(rds241-sha256.zip)= 3aa5dc0230444545a817cb9368bbfc28f4105822
MD5(rds241-sha256.zip)= 87542ab5610dc673f4406d0f1c333c9e

SHA1(rds241-sha256.txt)= 1580ecea496a34042f5b9db56e5f02307ffa68b9
MD5(rds241-sha256.txt)= 83234d8f550dd32f8b3706e47d5dd3d9

Note: SHA-256 test data is available.

Hashes of Blocks of Files - MD5 of the first 4096 bytes.

A text file is available which relates the MD5 of a complete file to the MD5 of the first 4096 bytes in the file (provided the file is that large).
A 426 MB Zip file can be downloaded which contains a 823 MB text file with 13,112,687 rows.
Each row has an MD5 hash, a tab character, and an MD5 hash.

Example rows:

FFFFF06ED6CEB23B016780FD24DFE620 4CF962C2E3815626FE28DE7B2918D8CF FFFFF19D706C0A754EBB553FEB03C724 D0CDC4D740BDF851D61E049D1DCFA139 FFFFF517FFD3E7425F3F15498595DA89 F5DCF00B42DFE803BD8114798FD67033

File signatures :
SHA1(md5b4096.zip)= dc70683f911d6a6254f37f09418faf0636267f3d
MD5(md5b4096.zip)= c458e36feef54c22226e2ae445e443d0

SHA1(md5b4096.txt)= 57445b7f4dcff3ad62fd05d170bfcc1e80b38b7f
MD5(md5b4096.txt)= ead485222f9f4f7f4a08b050b85d63ef

Hashes of Blocks of Files - MD5 of the first 8192 bytes.

A text file is available which relates the MD5 of a complete file to the MD5 of the first 8192 bytes in the file (provided the file is that large).
A 358 MB Zip file can be downloaded which contains a 638 MB text file with 10,164,753 rows.
Each row has an MD5 hash, a tab character, and an MD5 hash.

Example rows:

FFFFF06ED6CEB23B016780FD24DFE620 41805D5E6AEC565158DEEBB5AD8762B5 FFFFF19D706C0A754EBB553FEB03C724 AA8A7BFF6361797B1A06B05F66059644 FFFFF517FFD3E7425F3F15498595DA89 4B8F27CE545C766DF6E62309EF2A4A9F


File signatures :
SHA1(md5b8192.zip)= 5a6ffcf73f1303caf9b49e35867cca913c173d98
MD5(md5b8192.zip)= 1f810bfa6103ef96c436a749a3d3bc7a

SHA1(md5b8192.txt)= f81203fabb968a5f2f0eec1e228c380798bfbdb1
MD5(md5b8192.txt)= d09c1248ce6780a5cf4e9cc5946e1ebf

 

 

Contacts

Created May 16, 2016, Updated February 29, 2024