Human workflow automation streamlines report generation for 250% increase in productivity

The opportunity

An ed-tech company approached us to significantly reduce the labor and time costs of generating a specific type of report. Historically, each report required 40 hours to complete, with 150 such reports produced in 2023, representing a considerable operational bottleneck.

Our solution

We designed and implemented an end-to-end generative AI framework, automating the entire report generation process. Leveraging robust AWS services and integrating advanced generative LLM technologies, such as OpenAI's GPT 3.5 Turbo and GPT 4, we developed a nuanced system capable of understanding and executing report generation tasks with minimal human intervention.

Our system is built upon a complex network of language generation via sophisticated prompting strategies like Tree-of-Thought, Chain-of-Thought, and Self-consistency, ensuring accuracy and relevance in generated content. Our Retrieval Augmented Generation framework–anchored by a Postgres database equipped with pgvector for efficient data retrieval–employs Text Embeddings from OpenAI's ADA-002 and a custom fine-tuned embedding model built on HuggingFace's Transformers (Data2Vec). 

Built on a modern stack, the internal-facing user-friendly interface harnesses the power of NextJS, with FastAPI serving as the backbone for server-side operations. Carefully engineered data pipelines feed updated, semi-structured, real-time data into the system, ensuring that the AI's outputs are both current and contextually relevant. The system's ability to monitor efficacy and efficiency–(managed by CloudWatch and Prometheus) was crucial to the project’s success. This infrastructure, coupled with a CI/CD pipeline facilitated by GitHub Actions, ensured that our solution was not only robust but also adaptable to evolving business needs.

The results

This complex initiative culminated in an operational turnaround, delivering over a 250% return in productivity cost savings. Our deployment of generative AI technologies not only streamlined the report preparation process but also set a new benchmark for operational efficiency and innovation within the organization.