Silicon+Valley+No+CTA.png
 

Director, Data Engineering

Full Time – Redwood City, CA, United States

We’re looking for a Director of Data Engineering to be the primary engineering leader for our data development team. Our data development team is charged with collecting billions of data records and utilizing them within our applications. We’re seeking someone with both technical expertise working with high volume data pipelines as well as great leadership skills to inspire, develop and continue building a great team. The technical challenge is both wide and deep. We’re handling a full end-to-end process of obtaining large volume of records periodically then cleaning, indexing and wiring search functionality to deliver the data to our customers.

The Director of Data Engineering would also manage data science projects building complex algorithms using our acquired data. We’re looking for someone excited by the challenge of building the technical infrastructure to support an efficient data pipeline as well as finding the best ways that we can utilize this data to enhance the quality of our products.

WHAT YOU'LL DO:

  • Lead a strong team of ETL engineers, search specialists, application developers, and data scientists to efficiently and intelligently deliver new data to our customers

  • Architect, manage and own full new data pipeline from acquisition of raw data, through cleansing, indexing, search architecture, application work to deliver data to end users

  • Help drive the automation of key ETL and QA processes for a large volume of data acquisition (billions of records)

  • Provide leadership on key technology choices for entire data pipeline

  • Advise on appropriate load testing efforts to ensure high performance of our searches

  • Manage efforts of the search engineering team which builds search functionality for both our applications and for partner APIs

  • Lead a team of data engineers and scientists to create linking algorithms and search relevancy scoring algorithms

YOU'LL BE A FANTASTIC MATCH FOR THIS ROLE IF YOU BRING:

  • 10+ years of strong software engineering experience (with an emphasis on large scale search applications or building high volume data pipelines)

  • Passion for and experience in managing, growing and developing a top tier team

  • Superior organization, written communication and verbal communication skills

  • Strong understanding of the fundamentals of modern search algorithms. Helpful to have experience with a major search technology (SQL, lucene, elasticsearch)

  • Experience working on high throughput, distributed architectures

  • Good understanding of Apache Spark, Linux, and Airflow would be really helpful

  • Experience with databases including MS SQL Server and MongoDB

  • Experience with python .NET and C# would be very helpful

  • Experience in implementing performance test and QA automation preferred

  • BS/MS or beyond; degree in computer science, engineering, or applied mathematics a plus

TO WIT:

  • Conveniently located off of 101 in Redwood Shores

  • Business goals celebrated with Major Milestone Trips and frequent Friday Happy Hours

  • Company sponsored lunch daily

  • A start up’s pantry of complimentary beverages and snacks

  • High energy team with great mix of experienced entrepreneurs, talented engineers, and successful Silicon Valley veterans

  • Culture of acting with integrity

  • Competitive compensation including equity options

  • Comprehensive benefits package including medical/dental coverage, 401K, and life insurance

YOU BELIEVE WORK IS ABOUT MORE THAN JUST THE BOTTOM LINE

Bored employees make boring products. At Inflection, there’s no such thing. We run big websites with millions of users, but we’re allergic to the sterile and cold corporate culture. Work and life should definitely be buddies, so we’re serious about cultivating a fab work environment.

We don’t want to just be good at what we do; we want to be good for the world. We’ve met rigorous standards of social and environmental performance, accountability, and transparency. We care about all stakeholders, including customers, employees, and the community.