Data Engineer
Job No:
TECH21222361
Location:
Brisbane
How you'll make a difference ...
Working as a Data Engineer as part of our SaaS Data Analytics team, you will be responsible for expanding the functionality of our Data Services Platform by contributing to its architecture and development enabling Data Analysts and Data Scientists to more effectively operate. Using your can-do attitude and high value placed on customer experience, you will be an integral member of this exciting platform team.
What you'll be doing ...
- Architect and develop scalable and efficient data analytics patterns that can be reused across common use-cases
- Bring new ideas from concept to implementation, write quality, testable code, and participate in design/development discussions.
- Engage with internal and external stakeholders to gather requirements and opportunities to improve the Data Services Platform
- Thinking laterally to reduce operational costs and overheads of the platform
- Keeping the collected data separated and secure across the various boundaries defined by stakeholders and working with internal auditing and compliance teams to ensure appropriate guard rails are in place
- Create tooling to enable Data Analysts and Data Scientists team members to effectively consume and utilize the platform you will be managing
- Developing processes and guidelines that enable the delegation of control of aspects of the platform to technically proficient users.
Your talents...
- Passion for data, automation, analytics and understanding of new technologies and approaches to resolving problems at scale
- Previous experience working with and implementing solutions using AWS services such as:
- Kinesis
- Lambda
- Athena
- Glue
- Elasticsearch
- S3
- EMR
- Experience implementing and optimizing large scale data pipelines using both streaming and batch processing methodologies and tools such as: Spark, Kafka, Flink, Storm, etc
- Demonstrated experience with object orientated/scripting languages such as Bash, Python, Go, C#, Java, Scala, etc
- Familiar with the management of large-scale database services such as Elasticsearch, Redshift and various SQL/NoSQL based solutions
- Knowledge of machine learning algorithms, concepts and tooling is highly desirable
- An understanding of programmatic/configuration driven data flow platforms such as Airflow, Azkabham, Luigi etc
We value diversity and aim to create a vibrant and inclusive workforce. If you meet a number of the requirements (and not all), we encourage you to submit your application.
Who we are…
TechnologyOne (ASX:TNE) is Australia's largest enterprise software company and one of Australia's top 150 ASX-listed companies, with offices across six countries. We create solutions that transform business and make life simple for our customers. We do this by providing powerful, deeply integrated enterprise software that is incredibly easy to use. Over 1,200 leading corporations, government departments and statutory authorities are powered by our software.
We pride ourselves on providing our people with earned recognition through career progression, competitive salaries and a supportive environment. We double in size approximately every 4 - 5 years so career opportunities are abound. Everything is about to change. Are you ready?
We value creativity, innovation and people with an entrepreneurial spirit. See us in action at Hack Day!
* Applicants must have the right to work permanently in Australia.