Overview:
Program to resolve domains, their SOA , dkim , spf settings, mx records, mx host preference and the A and AAAA records of those mx hosts. The records should be stored in a database along with a time stamp of when they were resolved.
The program will continuously run and keep the records updated. Any records that change such as MX host for domain, A record for MX host, AAAA record, should be logged in a separate "history" table and the main table updated with the most recent information. Also if the domain stops resolving the domain should be logged in another table.
I would like to be able to adjust the amount of 'resolvers' or 'threads' the program will run. This way if I have to import a large set of new domains I will be able to resolve them more quickly.
Requirements:
I would like to be able to resolve 5 million domains in under 24 hours or about 4000/second. I have enough hardware and bandwidth to accomplish this. I also have setup my own dns resolvers.
I don't care what programming language this is done in or the database you choose to use. I do request that mongo is not an used and I do not want this written in PHP.
My implementation will done with use of Java Concurrency API and MySQL. It should handle 4000 req/s without a problem. You'll be able to tune it (thread pool size) or even run concurrently from few machines if you need to resolve domains faster.
$1,111 USD in 5 days
5.0 (9 reviews)
6.5
6.5
15 freelancers are bidding on average $1,681 USD for this job
Hello,
I can make this program in C/asm. The code will be as short as possible and optimized for performance.
I am native Russian, live in Thailand - so I have both free time and desire to work on this project.
I have 15 year extensive experience with Linux and AIX system administrating and C programming.
troubleshooting
Linux with mysql is the best choice for your project. I can do a binary program in free pascal that resolves your hostnames against your defined dns server. It will be fast and you can run as many instances of the program that your hardware supports, so there's practically no limit.
I will also create a script that runs each instance with a set of domains to resolve, so they don't overlap resolving the same domain more than once. And you can set the script to run hourly, daily or as often as you need with the linux cron daemon.
the program will:
add the records to a table if the domain is not found.
update each record timestamp
log any record change
I will be in Los Angeles at the end of May, so we can meet there to review it in person.
It's an easy task for us. We have gone through your requirements and we are ready to start the work immediately on your project. We will send you the complete list of company's projects and portfolio once you reply us back. Also please check the PMB.
Thanks.