Job Description
We are seeking a Senior/Staff Elasticsearch Engineer to architect and manage scalable, high-performance search infrastructure tailored to document and file management. This role is critical to powering search and discovery for business-critical documents.
Job Description:
Responsibilities
•Design, implement and manage scalable ElasticSearch clusters optimized for indexing and querying large volumes of documents
•Drive architectural reviews and provide technical guidance on complex search implementations.
•Administer the operations of multiple production ElasticSearch clusters across different environments.
•Drive observability and monitoring for ElasticSearch clusters.
•Implement robust ingest pipelines for structured and unstructured file types.
•Develop and fine-tune full-text search features for relevance, speed, and accuracy
•Integrate file parsing tools (e.g., Apache Tika, ingest-attachment plugin) into indexing workflows.
•Conduct regular security audits and vulnerability assessments.
•Provide technical support to internal and external staff.
•Participate in incident calls and problem resolution.
•Architect index structures, lifecycle management, and document storage patterns
•Ensure secure access to document content through fine-grained RBAC and SSO integration
•Build metadata extraction and enrichment services to augment searchability
•Automate ingestion pipelines using scripting (Python, Bash, PowerShell)
•Develop dashboards for search/reporting use cases in collaboration with product teams
•Collaborate with Engineering to optimize search integration and performance.
•Deploy and manage Kafka instances.
•Cluster tuning and scaling with focus on fast search and analytics at scale.
•Carry out capacity planning and migrations to optimize cluster performance.
Required Skills:
• 5+ years' experience designing and managing production ready multi cluster ElasticSearch instances.
• 4+ years of experience administering Linux systems.
• Infrastructure as Code proficiency (Terraform)
• Experience using Monitoring and Observability solutions
• Proficiency with Cloud Platforms e.g (AWS, Azure) with experience in managed ElasticSearch services.
• Profiency with an automation scripting language (Python, Powershell, bash, Go)
• Strong knowledge of ingest-attachment plugin, pipelines, and file parsing tools
• Proficient in Search DSL, aggregations, and performance tuning