Internal Application: Search Engineer

About Us

At Diffbot, we believe that access to structured information will be the critical resource for the coming wave of intelligent applications—for everything from new app experiences, to search assistants, to enterprise business intelligence. 

That’s why our team of world-class AI engineers is building a machine that can autonomously synthesize the world’s largest database of structured information and looking for those that want to join us on this mission.  

Search Engineer

Diffbot uses a commercial version of the Gigablast search engine and crawler, written in C++, to discover web pages for processing. Once Diffbot has converted these web pages to JSON, they are then indexed for searching. Efficiently crawling the web using a distributed cluster of servers is a continuing challenge. Implementing innovative algorithms to improve the quality and performance of the search function is another. 

As a Search Engineer at Diffbot you will be part of an elite team building the world’s largest database of structured knowledge.

Responsibilities

• Improving performance and reliability of search infrastructure

Requirements

• Experience in C/C++ and Linux

• Experience writing algorithms for speed and scalability

Preferred Skills

• Experience with Github

• Experience with datacenter operations & monitoring

To apply, please submit:

• Resume / LinkedIn / homepage

• A short self-introduction  (describe your interest and area of speciality)

• How did you hear about Diffbot?