CASE STUDY

Engineering Full Text Search for a Large Messaging Platform

For a messaging provider serving more than three million users and handling over ten billion messages per month, Innovent delivered full text search through relevance engineering, capacity planning, and production implementation.

Client

SaaS messaging and collaboration services provider

Industry

Messaging and Collaboration Software

The Challenge

A messaging services provider wanted to expand search from message headers to the full contents of email messages. Its platform served more than three million users and handled over ten billion messages per month within a primarily Microsoft-based environment using .NET and SQL Server.

Introducing full text search required determining how search technology would integrate with the platform and what infrastructure it would need. Document volume, message sizes, ingestion rates, query demand, language requirements, and projected growth all influenced the design.

Innovent’s Approach

Innovent began with a prototype using a sample of the client’s data in a development environment. Working with the client, the team defined desired search features and behavior and applied relevance engineering to evaluate retrieval quality, refine requirements, and assess the implications for server sizing.

The prototype work addressed architecture, configuration, index update methods, and language support. This provided a practical foundation for establishing the production system.

Innovent then worked with the client to characterize the production workload. The analysis considered the anticipated number of indexed documents, average document size, the distribution of small and large messages, and expected growth.

Capacity planning also accounted for average and peak ingestion throughput, update requirements, anticipated query volume, and features such as filtering, sorting, and faceting. These requirements informed the architecture and sizing of the production search environment.

Following the prototype and planning work, Innovent established the production system to support full text message search.

The Result

The engagement progressed from prototype evaluation to a production search system, expanding retrieval beyond message headers to the contents of messages.

Innovent combined relevance engineering with workload analysis and production architecture to deliver the new search capability. Infrastructure planning was grounded in the provider’s message data, anticipated traffic, and growth requirements.

Make search work better for your organization

Talk with Innovent about improving search relevance, reliability, and performance, or planning your next implementation.