ShopStyle, the leading product search engine on the web, is looking for an ambitious Data Engineer to help build out the team. ShopStyle attracts over 10 Million monthly users. By aggressively keeping up with new technologies we hope to expand on that number. Our freshly built stack is as new and modern as can be. It's ready for rapid development, iteration, and you.
Together we're building the next generation of social shopping with the best quality content and user experience in the market. We're looking for a leader to help us design, drive, and build: interactive search and real-time filtering; mobile shopping; great social and sharing features; a killer API and widget program; international content; scaling, performance, big data, and much more.
About the job:
You will work with a talented team of engineers to build scalable, fault-tolerant systems for dealing large volumes of data.
You will work closely with the data science team to create an analytical platform to facilitate analysis and A/B testing on top of massive search and user data.
You will get to work on all aspects of the data infrastructure, getting your hands dirty with cutting edge technologies and touching everything in the pipeline from data ingestion, ETL, processing, to analytics and machine learning.
You will be get to solve the challenges of scaling and optimization of the internal data flow as business needs change or expand.
You get to experiment, tweak, tune, optimize and rethink solutions on a daily basis.
2+ years experience with data warehouse technical architectures with technologies like Hadoop, Scalding or Spark
Strong understanding of NoSQL database design, caching and scalability with technologies like HBase, DynamoDB or MongoDB
Familiarity programming with and building RESTful APIs
Proficient in Java or Scala with solid competencies in software design practices
Excellent communication skills and willing to work cross-functionally with other engineering teams across the organization
Bachelors Degree or higher in an engineering or technical field, CS degree
Nice to Have:
You know what the Lambda Architecture is
Experience with lightweight front-end and visualization frameworks
Familiarity with Amazon AWS and Unix machines
Highly qualified candidates will have hands on experience with any of the following; Hadoop, Scalding, Cascading, Storm, Spark, RedShift, HBase, MongoDB, Kinesis, Kafka, Scribe, Flume
This position is ideal for someone with distributed computing experience interested in developing Big Data/Machine Learning skill sets.