الوصف الوظيفي
SUMMARY
You will architect and develop Peg B data platform designed to support massive scale structured and unstructured real-time data. You will lead the design and development of distributed systems infrastructure that is scalable, highly performant and able to handle diverse data sets.
Duties and Responsibilities
• Build distributed systems – work on improving and adding new functionality to Peg B distributed systems backbone.
• Work with very large datasets and implement algorithms that improve the quality and usefulness of our data assets.
• Support benchmarking systems, analyze system & query bottlenecks and propose solutions to eliminate them.
• Scale the network – work on tuning and optimizing the delivery of various data sets in a network with thousands concurrent events and unique data scalability challenges.
• Keep it running – help troubleshoot data systems and application operational issues.
• Design and implement features evolving our data platform product offerings.
• Deliver software designs that have resilience, performance and security baked into their DNA.
• Develop instrumentation/profiling tools and systems.
• Learn and grow – learn from experts and expand your skills and responsibilities.
• Mentor junior members.
• Work with Product management on understanding features.
• Own a problem end to end.
المهارات
Qualification
• Bachelor’s Degree in Computer Science or related technical discipline or its equivalent.
• 5+ years of professional experience focusing on building and managing data distributed systems infrastructure using open source software in a large-scale environment.
• Good understanding and experience of computer algorithms and preferably machine learning.
• Strong foundation in mathematics.
• 3+ years in a direct role as a designer / architect for ETL and/or EDW systems.
• 3+ Years - Data Modeling Experience; Delivering both logical models and physical designs.
• 3+ years of experience with MPP stands for Massive Parallel Processing relational databases (Vertica/Redshift).
• Technical expertise in distributed system architecture, design, and development
Knowledge and Experience
• Proficiency with agile development methodologies.
• Proficiency with linux/unix based systems.
• Proficiency with Big Data processing technologies (Hadoop, Spark, Scala).
• Proficiency with data warehouse solutions (Redshift).
• Proficiency with Git (Bitbucket, GitHub).
• Hands on experience with the latest technologies: Storm, MySQL, Cassandra, MongoDB, DynamoDB, Kafka, HBase, ElasticSearch.
• Experience in a startup.
• Proficiency with MySQL NDB Cluster.
• Experience with containerized applications running in Docker, Kubernetes is preferred.
Skills
• Can think critically through hard problems and emerge with robust, functional solutions.
• Can work with others to produce industrial strength code.
• Excellent written and verbal communication skills.
تفاصيل الوظيفة
منطقة الوظيفة دبي, الإمارات العربية المتحدة
قطاع الشركة تكنولوجيا المعلومات
طبيعة عمل الشركة صاحب عمل (القطاع الخاص)
الدور الوظيفي تكنولوجيا المعلومات
نوع التوظيف دوام كامل
الراتب الشهري غير محدد
عدد الوظائف الشاغرة غير محدد
الرقم المرجعي للوظيفة JB3779596
المرشح المفضل
المستوى المهني متوسط الخبرة
عدد سنوات الخبرة الحد الأدنى: 5
منطقة الإقامة الإمارات العربية المتحدة
الشهادة بكالوريوس/ دبلوم عالي
https://www.bayt.com/ar/uae/jobs/data-engineer-3779596/