AIOps: How to Solve Performance Issues in Complex Data Pipelines

BALA VENKATRAO | January 15, 2019

article image
There seems to be a chasm between DevOps and big data teams in the enterprise, and the bridge over that chasm is long and treacherous.In fact, data analysts who are charged with managing and making sense of the growing volumes of data in most organizations traditionally have been excluded from the strategy-making and operations functions of DevOps personnel. Yet, data analysts are critical to the success of software development and at every stage of the software delivery pipeline. Let’s take a deeper look. We know that DevOps personnel are on the front lines in ensuring that all systems, both new and existing, perform as expected in a production environment. But, even today, DevOps teams struggle in dealing with technical challenges when faced with complex data pipelines and the underlying big data stack that supports them, including. The pressure is on. On average, companies with data-driven environments garner up to 50 percent higher market value than their competitors, according to IDC, and big data is a contributing factor. Thus, big data implementations have become a top priority for businesses of all sizes, and on multiple fronts: revenue acceleration, creation of new products and contributing to better, quicker decision-making.

Spotlight

TAZ Networks, Inc.

TAZ Networks provides IT support and IT Services for small and medium businesses in Michigan. We service the Ann Arbor and Detroit metro areas. TAZ Networks ensures your business excellence through the use of technology. Our team acts as the IT department for small to medium sized businesses in Michigan. We provide managed technology support with a dedicated help desk and 24x7 server monitoring at a monthly flat rate that is guaranteed lower than hiring even a junior technician.

OTHER ARTICLES

Fortinet Forges FortiAI Security Service

Article | February 25, 2020

Fortinet lent overworked and understaffed security operations (SecOPs) teams a helping hand today with the launch of FortiAI, an artificial intelligence (AI)-powered threat detection and remediation service.“FortiAI is designed to optimize security operations, enhance the productivity of the security analysts, and to reduce the false-positive rate,” said Jonathan Nguyen-Duy, VP of Fortinet’s global field CISO team, in an interview with SDxCentral.To do this, FortiAI utilizes a “self-learning” deep neural network (DNN) to automate rote security tasks to accelerate threat detection and remediation.“The practical reality is the complexity is expanding beyond the ability of conventional security operations to keep pace and so artificial intelligence and its subsets in machine learning and deep learning are all designed to automate those more mundane tasks,” Nguyen-Duy explained.

Read More

VMware Adds More Hybrid Cloud Features to Network Virtualization Tech

Article | April 8, 2020

VMware on Wednesday announced new versions of its NSX-T and vRealize Network Insight software that simplify network virtualization and improve network visibility and security. The two products, along with VMware SD-WAN by VeloCloud, make up VMware’s Virtual Cloud Network, the company’s portfolio of software defined networking (SDN) technologies. It allows enterprises to deploy and manage network connectivity and security from internal data centers and branch locations to multi-cloud environments. While previous versions of NSX-T network virtualization and security software for data centers added support for public clouds and platforms that run containers on bare metal, the latest release, NSX-T 3.0, adds new networking and security features that improve the company’s vision to deliver a public cloud experience on premises, VMware executives said.

Read More

Essential things to know about container networking

Article | March 8, 2020

Containers have emerged over the past several years to provide an efficient method of storing and delivering applications reliably across different computing environments. By containerizing an application platform and its dependencies, differences in OS distributions and underlying infrastructures are abstracted away. Networking has emerged as a critical element within the container ecosystem, providing connectivity between containers running on the same host as well as on different hosts, says Michael Letourneau, an IT architect at Liberty Mutual Insurance. "Putting an application into a container automatically drives the need for network connectivity for that container," says Letourneau, whose primary focus is on building and operating Liberty Mutual's container platform.

Read More

Researchers Explore Details of Critical VMware Vulnerability

Article | April 17, 2020

Researchers have published the details of an investigation into CVE-2020-3952, a major vulnerability in VMware's vCenter that was disclosed and patched on April 9. The flaw was given a CVSS score of 10. CVE-2020-3952 exists in VMware's Directory Service (vmdir), which is a part of VMware vCenter Server, a centralized management platform for virtualized hosts and virtual machines. Through vCenter Server, the company says, an administrator can manage hundreds of workloads. The platform uses single sign-on (SSO), which includes vmdir, Security Token Service, an administration server, and the vCenter Lookup Service. Vmdir is also used for certificate management for the workloads vCenter handles.

Read More

Spotlight

TAZ Networks, Inc.

TAZ Networks provides IT support and IT Services for small and medium businesses in Michigan. We service the Ann Arbor and Detroit metro areas. TAZ Networks ensures your business excellence through the use of technology. Our team acts as the IT department for small to medium sized businesses in Michigan. We provide managed technology support with a dedicated help desk and 24x7 server monitoring at a monthly flat rate that is guaranteed lower than hiring even a junior technician.

Events