from Hacker News

Show HN: 3B+ 152GB DNS Records Dataset

by pierrebarre on 10/14/24, 7:00 PM with 0 comments

Hi HN,

I've been working on building a pipeline to create a DNS records database lately. The goal is to enable research as well as competitive landscape analysis on the internet.

The dataset for now spans around 3 billion records and covers all the common DNS record types:

    A
    AAAA 
    ANAME
    CAA
    CNAME
    HINFO
    HTTPS
    MX
    NAPTR
    NS
    PTR 
    SOA
    SRV
    SSHFP
    SVCB
    TLSA
    TXT
Each line in the CSV file represents a single DNS record in the following format:

    www.example.com,A,93.184.215.14

I believe this dataset will be valuable for various research purposes and competitive analysis. Let me know if you have any questions or feedback!