Senior Software Engineer - Data Infrastructure

Location: Vancouver, British Columbia, Canada

Department: Engineering

Type: Full Time

Min. Experience: Experienced

TL;DR: STAT Search Analytics is looking for a talented Senior Software Engineer to join our Data Services team with a minimum of ten years experience who is ready to take on challenges driven by our growth.

We're a Vancouver-based tech company that’s been growing steadily over the last six years, with no signs of slowing down. Our product is a complex, distributed, multi-component system that gathers, analyzes, and delivers high-volume statistical information for our enterprise clients, fresh every day. 

You’ll have the opportunity to work with cutting-edge technology while helping to evolve our system and build our team.  STAT is privately owned and 100 percent revenue-funded, with a roster of happy clients that includes some of the world’s largest online companies, like Netflix, eBay, Pinterest, and more.

OUR TECHNOLOGY

Here’s what you’ll be working with:

Our distributed system runs both synchronously and asynchronously, using some of the newest technologies available. We are based entirely on Amazon Web Services and make use of a wide array of AWS components. Our application is database-heavy, with about 20 Terabytes held across 20 RDS instances and a MongoDB cluster. We move many millions of jobs through Redis and Resque every day. EC2 instances are Linux-based and the primary programming language on the servers is Ruby.

Our customers are located worldwide and our data acquisition takes place 24 hours a day—which means that we need close to 100 percent uptime across most of our services. Resilience and adaptability are key.

Your main duties and responsibilities:

  • Plan, design, and coordinate the development of new software components for our data collection and data aggregation system using Ruby and components such as Redis, MongoDB, Resque and MySQL.
  • Maintain and refactor existing software components for the data collection and data aggregation system using Ruby and components such as Redis, MongoDB, Resque and MySQL.
  • Through research and evaluation, improve and evolve STAT’s data collection systems to be more reliable, faster, and cost efficient.
  • Work with the Data Services team to manage the operation of STAT's data collection systems ensuring that they are running smoothly at all time, upgrading, and developing maintenance procedures as needed.
  • Maintain a healthy inventory of proxy IPs for STAT’s data collection systems, which includes (but is not limited to) continuously testing proxy IPs, and communicating with existing and new IP vendors.
  • Perform Amazon Web Services (AWS) server administration including normal system administration tasks, and deploying new servers for testing and production use whenever necessary.
  • Draft technical documentation of our software, development environments, production environments, and procedures. This documentation is primarily for in company use by our development team.
  • Participate in team level meetings and discussion for software design, software development, and code review.
  • Discuss progress on work being undertaken by yourself and the Data Services team on a regular (daily and weekly) basis with the rest of the development team and/or the Company Owner.
  • Discuss and participate in the ongoing refinement of our software development process.

REQUIREMENTS

You’ve got experience

You should have at least three years of experience in Data Infrastructure and Analytics engineering and should be comfortable leading development teams in an agile-like process. This role is very hands-on and will be focused on system architecture, software design, research, testing, and development.  

You’ve got education

At a minimum, you should have a post-secondary diploma or equivalent degree in computer science, engineering or a related discipline.

You’ve got skills

We are looking for people who are confident working in our technical landscape, including distributed technologies and software-as-a-service. In order to be eligible for this role, we need you to display competency in the following areas:

  • Ruby or other scripting languages like Python, Go etc.
  • TCP/IP networking and HTTP protocol
  • Linux OS like Ubuntu, CentOS, AmazonAMI etc
  • SQL databases like MySQL, Postgres, MS SQL Server
  • NoSQL databases like MongoDB, CouchDB, DynamoDB, Redshift etc.
  • Queue Management Systems like Redis/Resque, ZeroMQ, Celery etc.
  • BDD or TDD development in an Agile-like process
  • CI, provisioning and deployment using Travis, Chef and capistrano respectively
  • Source control like Git, Visual Sourcesafe
  • Amazon cloud technologies like EC2, RDS, S3

PERKS

A few side benefits of working here:

  • Three week paid vacation, plus everyone gets an extra two-week paid vacation leading up to New Year’s.
  • Shorter summer hours to take advantage of that elusive Vancouver sunshine.
  • Free gym memberships.
  • Medical package including dental, optometry, prescriptions, massage, and physio.
  • A relaxed and welcoming work environment

CULTURE

Our Development culture at STAT is an open and collaborative agile like workflow. We believe that the best way to solve challenging engineering problems is to bring the most inventive ideas together through discussion and then implement solutions through an iterative process that involves constant communication and feedback.

We believe the best way to foster growth and creativity is to bring multiple minds together on an issue and then make one individual responsible for ultimately solving it. We are never hesitant to ask for help/advice and never too busy to offer the same.

We're a small, highly focused team of experts, doing world-class, global-scale data mining and classification. We're also building interfaces around this data that allow our enterprise customers to leverage the insights we provide in order to grow their businesses. Our customers love us.

Our founder & CEO is a software developer at heart, so we have a development-focused culture. We're a 100% revenue-funded private company with a strong sense of craft. We are focused on delivering excellent work, and having a great time while doing it.

Forward this Position
Recipient email address (one)
Your name
Your email address
Enter a message (optional)
Human Check*
Apply for this Position
* Required fields
First name*
Last name*
Email address*
Location
Phone number*
Resume*

Attach resume as .pdf, .doc, or .docx (limit 2MB) or paste resume

Paste your resume here or attach resume file

Cover Letter
In 150 characters or fewer, tell us what makes you unique. Try to be creative and say something that will catch our eye!*