Reverse Beacon Network Data
The files below contain Reverse Beacon data in a couple of different formats.
Of course there are invalid callsigns in the dataset but here are some interesting numbers from the raw RBN dataset February 21 2009 - January 14, 2015
- 356,161,858 database records
- 874,699 unique "DX" callsigns
- 20,503 /P portable callsigns
- 17583 /# callsigns
- 9,524 /QRP callsigns
- 5861 /M mobile callsigns
- 1165 /MM maritime mobile callsigns
- 307 /QRPP callsigns
- 50 /AM air mobile callsigns
PostgreSQL SQL Format:
3 GB compressed / 76.3 GB uncompressed
Felipe, PY1NB of the Reverse Beacon Network recommended I use PostgreSQL and after working with it I can understand why. The volume of data the RBN has collected is huge but PostgreSQL makes the most of the hardware you give it.
Disk space requirements: you'll need 3 GB (the bz2 file) + 76.3 GB (the unzipped SQL file) + 85 GB (the disk space the database requires after import is complete)
1) Install PostgreSQL and make sure you have the commandline utility psql installed and on your path,
2) Decompress the SQL file
3) Run the command:
psql -U postgres -q -f PostgreSQL-Data.sql
The SQL code echoes, on the console, the year/month/day the PostgreSQL server is importing. This allows you to watch how the import is progressing.
On my computer it took just about 12 hours to import the data but slower machines will take longer. After importing the data, simple queries for the indexed fields are in the millisecond range (e.g. 15ms). That's pretty amazing considering that the data from 2009 through beginning of 2015 amounts to 356 million records!
Incidentally, if you need a text editor that works with a 76 gigabyte file, try the 010 Editor. The 010 Editor consumes 25 MB of memory while easily handling a 76 GB file and you can scroll through it as fast as you can a 3K file!
SQLite .db Format (2009 to 2013/04):
4.4 GB compressed / 25.4 GB uncompressed
Microsoft Access .accdb Format:
4.5 GB compressed / uncompressed = 26 GB
- rbn-skimmer-2013-partial.rar (January 1 - August 28)
The linked_DBs file allows you to see all the tables at one time and query across them all though this is less than ideal. You are much better off installing PostgreSQL if possible.
All .rar files should be placed in the same directory. To get this running:
Open rbn-skimmer-linked_DBs.accdb and go to the "DB_Updater" Module
Run the subroutine DeleteSkimmerLinkedTables. Close and Compact the database (the old table definitions are orphaned until a database compaction occurs). Run the subroutine UpdateLinkedPaths.
To have the Queries updated run the subroutine DeleteQueryDefs. Compact the database (the old query definitions are orphaned until a database compaction occurs). Run the UpdateQueryDefs routine.