To construct a sophisticated, AI-driven structure [Figure 2] able to scaling and fixing information high quality and observability challenges, Telmai thought of numerous cloud computing platforms. The corporate chosen Google Cloud as a result of Google Cloud’s managed and serverless elements — together with Dataproc, Pub/Sub, Google Kubernetes Engine (GKE), and BigQuery — provided the perfect financial and efficiency worth. With a contemporary structure on Google Cloud, Telmai’s observability answer is fast to deploy for startups and scale to enterprise use instances on demand.
Through the use of Spark (working by way of Google Cloud Dataproc) because the processing engine, Telmai is ready to decouple information high quality evaluation and anomaly detection from the underlying operational techniques akin to BigQuery, which affords three benefits:
-
Open structure: Telmai’s decoupled structure permits calculating (and constantly monitoring) information high quality metrics and thresholds for any sort of underlying system in clients’ information pipelines with out overloading these techniques. This open structure provides information architects the pliability so as to add, improve, or swap information techniques with out worrying about redesigning their information high quality and observability.
-
Scalability: Spark provides Telmai the flexibility to design extremely optimized and scalable algorithms particular for information monitoring, the place the standard method of working SQL queries fell brief. A scalable structure with elastic assets provides Telmai Knowledge Observability Platform the flexibility to watch a whole lot of tens of millions of knowledge metrics and their traits so the answer can validate information effectively, in parallel, and with excessive throughput — for instance, information with 100 million+ rows of JSON buildings of 1,000+ attributes. Counting on Dataproc service offers resilience and ease of operation at scale; clusters autoscale, spin up, and cease when required. This retains answer prices down for purchasers.
-
Safety and operations: Google Cloud offers a excessive stage of management for safety. Safety ranges from basic-level measures like multi-factor authentication, single sign-on, key retailer, granular roles, and ease of separating improvement from manufacturing environments, to extra subtle measures akin to Safety Command Middle to trace and remediate vulnerabilities.
One of many largest safety dangers for any group is human error, so it is important to outline and function infrastructure as code to standardize deployments and reduce probabilities of misconfigurations or exposures. By leveraging Kubernetes and GKE, Telmai is ready to not solely additional scale back such danger, but additionally to run Telmai deployments with low effort in clients’ accounts solely (personal cloud possibility), making certain that each one information stays inside their secure perimeter.
These advantages collectively gave Telmai large pace in improvement, together with supporting new integrations. By counting on managed companies like Dataproc and GKE, Telmai can concentrate on constructing its software relatively than on working the software program. The infrastructure, auto-scaling, safety, DevOps, and extra are available for Telmai by way of the Google Cloud stack.
Google Cloud and Telmai: Companions in information observability
Google Cloud helps know-how firms like Telmai construct progressive functions on Google’s information cloud with simplified entry to know-how, useful and devoted engineering assist, and joint go-to-market packages.
Study extra about Google Cloud’s open and progressive generative AI accomplice ecosystem and about Telmai and Google Cloud.
