Big Data Lead Engineer

Posted time October 14, 2025 Location Sydney Job type Full-time

Skills/Experience:

  • Proficient with Java, Scala/Spark, API and Streaming – Primary
  • Proficient with Pyspark, Python and SQL.
  • Experience in Azure cloud platform.
  • Expertise in various connectors and pipelines for batch and real-time data collection/delivery.
  • Performance tuning – table partitioning and indexing, process threading.
  • Should have worked in Agile
  • Experience of working in JIRA and Confluence