TB Prin. Data Eng (I)

Job Number: 174836 Primary Location: North Sydney New South Wales
Schedule: Full-time Organization: TB International

Primary Responsibilities:

As a Principal Data Engineer I, you will provide technical and managerial leadership to a world class engineering team that designs and develops path-breaking large scale cluster data processing systems. You will collaborate with Sales and Services Directors to develop new business and manage existing client relationships. You will mentor sophisticated organizations on large scale data and analytics and work with client teams to deliver results. As a senior member of the consulting team, you will help Think Big establish thought leadership in the big data space by contributing white papers, technical commentary and representing our company at industry conferences.

 

Secondary Responsibilities:

You will mentor junior members on the team in application architecture, design and development best practices. Support and manage internal asset development projects. Complete other duties as assigned.


Job Qualifications:

· Prior consulting experience required

·PPrior experience managing client relationships

· 5 years of experience managing software teams

·       7 years of experience programing in Java or C/C

·       Proficient in SQL, NoSQL, relational database design and methods for efficiently retrieving data

·       Prior experience with Hadoop, HBase, Hive, Pig and Map/Reduce and Spark

·       Experience building complex and non-interactive systems (batch, distributed, etc.)

·       Must be adept at sizing and estimating new projects, as well as have experience supporting new business development

·       Must have strong analytical skills and be a creative problem-solver

·       Excellent verbal and written communications skills

·       Adept at learning and applying new technologies

·       Strong team player capable of working in a demanding start-up environment

 

Preferred Knowledge, Skills and Abilities:

·    Experience with JMS: ActiveMQ, RabbitMQ, JBoss, etc.

·    Dynamic and/or functional languages (e.g., Python, Ruby, Scala, Clojure)

·    Experience designing and tuning high performance systems

·    Prior experience with data warehousing and business intelligence systems

·    Linux expertise

·    Prior work and/or research experience with unstructured data and data modeling

·    Familiarity with different development methodologies (e.g., agile, waterfall, XP, scrum, etc.)

·    Demonstrate understanding of “var” vs “val”, use of multi-return methods, ability to write clean, legible scala code that solves a complex problem

·    Firm understanding of Python memory model, classes, subclassing, designing classes for re-use, static string constants rather than in-line constants

·    Understanding of various analytic and visualization utilities available in R

·    Experience with Elasticsearch, SolrWeb, and Lucene

·    Experience with Star Schema, fact vs dimensions, updates/restatements and views

·    Able to create and deploy a Samza job via YARN or Mesos, read from a streaming source (like Kafka) and produce some filtered or enhanced output

·    Able to create storm topology to filter or transform a stream of data. Ability to track state and isolation in Trident or similar

·    Able to connect DStream to Kafka or Flume (or similar) queue, filter or transform data and write back to DStream on a different topic/queue

·    Implementation of D3, Tableau or R graphing technologies that produce an intuitive view of the underlying data

·    Implement a graph (line or pie etc.) baked by a live (changing) data set, something like “request per minute” or similar

·    Understand basic modeling techniques and tool sets. Implement simple Python or R analytic routines.

 

Job Abilities:

Must be able to sit for long periods of time working on computers. Must be able to travel to client sites at least 50% of the time. Must be able to interact and communicate with the client in meetings. Must be able to write programming code in applicable languages. Must be able to write project documentation in English.

 

Education:

Bachelor's Degree or foreign equivalent in Computer Science or related technical field followed by eight (8) years of progressively responsible professional experience programming in Java, Python or C/C . Experience with production software development lifecycle. Experience with Linux, SQL, relational database design and methods for efficiently retrieving data. Experience building complex and non-interactive systems (batch, distributed, etc.).

 

OR

 

Master's Degree or foreign equivalent in Computer Science or related technical field. Six (6) years of experience programming in Java, Python or C/C . Experience with production software development lifecycle. Experience with Linux, SQL, relational database design and methods for efficiently retrieving data. Experience building complex and non-interactive systems (batch, distributed, etc.).

 

Employer will accept any suitable combination of education, training, or experience.



Qualifications




Apply Now




Interested?

Apply Now