The Data Landscape is Fragmented, but Your (Logical) Data Warehouse Doesn’t Have to Be

The current data landscape is fragmented, not just in location but also in terms of shape and processing paradigms: data lakes, IoT architectures, noSQL and graph data stores, SaaS vendors, etc. are found coexisting with relational databases to fuel the needs of modern analytics, ML and AI. In the past, traditional data warehouses were the tool of reference for consolidating data in a single location for analytics. But although they still play a pivotal role in a company strategy, the data available in other systems can’t be ignored. Physical re-consolidation of that data back to a single location, although possible, becomes less appealing by the day.

Spotlight

Axion

Axion is a leading IT Services, Internet Service Provider, & Federal Contracting firm based just 40 miles from Kansas City in beautiful Warrensburg, Missouri. We support clients within 60 mi. of Warrensburg. Our clients range from 2 person startups with big and innovative ideas, to organizations like the United States Department of Homeland Security. We offer a full menu of services including IT support, IT Consulting, Dedicated Internet, Application Development, Managed IT Services (email, hosting, server virtualization), network design and installation, cloud services and migration, and IT purchasing. We are a one-stop shop for anything IT and we don’t do “ticketing”. Every contact is personal, every root cause is analyzed, and no project is impossible.

OTHER ARTICLES
Virtual Desktop Strategies

VMware Tanzu Kubernetes Grid Integrated: A Year in Review

Article | July 26, 2022

The modern application world is advancing at an unprecedented rate. However, the new possibilities these transformations make available don’t come without complexities. IT teams often find themselves under pressure to keep up with the speed of innovation. That’s why VMware provides a production-ready container platform for customers that aligns to upstream Kubernetes, VMware Tanzu Kubernetes Grid Integrated (formerly known as VMware Enterprise PKS). By working with VMware, customers can move at the speed their businesses demand without the headache of trying to run their operations alone. Our offerings help customers stay current with the open source community's innovations while having access to the support they need to move forward confidently. Many changes have been made to Tanzu Kubernetes Grid Integrated edition over the past year that are designed to help customers keep up with Kubernetes advancements, move faster, and enhance security. Kubernetes updates The latest version, Tanzu Kubernetes Grid Integrated 1.13, bumped to Kubernetes version 1.22 and removed beta APIs in favor of stable APIs that have since evolved from the betas. Over time, some APIs will evolve. Beta APIs typically evolve more often than stable APIs and should therefore be checked before updates occur. The APIs listed below will not be served with v1.22 as they have been replaced by more stable API versions: Beta versions of the ValidatingWebhookConfiguration and MutatingWebhookConfiguration API (the admissionregistration.k8s.io/v1beta1 API versions) The beta CustomResourceDefinition API (apiextensions.k8s.io/v1beta1) The beta APIService API (apiregistration.k8s.io/v1beta1) The beta TokenReview API (authentication.k8s.io/v1beta1) Beta API versions of SubjectAccessReview, LocalSubjectAccessReview, SelfSubjectAccessReview (API versions from authorization.k8s.io/v1beta1) The beta CertificateSigningRequest API (certificates.k8s.io/v1beta1) The beta Lease API (coordination.k8s.io/v1beta1) All beta Ingress APIs (the extensions/v1beta1 and networking.k8s.io/v1beta1 API versions) Containerd support Tanzu Kubernetes Grid Integrated helps customers eliminate lengthy deployment and management processes with on-demand provisioning, scaling, patching, and updating of Kubernetes clusters. To stay in alignment with the Kubernetes community, Containerd will be used as the default container runtime, although Docker can still be selected using the command-line interface (CLI) if needed. Networking Several updates have been made in regards to networking as well including support of Antrea and NSX-T enhancements. Antrea support With Tanzu Kubernetes Grid Integrated version 1.10 and later, customers can leverage Antrea on install or upgrade to use Kubernetes network policies. This enables enterprises to get the best of both worlds: access to the latest innovation from Antrea and world-class support from VMware. NSX-T enhancements NSX-T was integrated with Tanzu Kubernetes Grid Integrated to simplify container networking and increase security. This has been enhanced so customers can now choose the policy API as an option on a fresh installation of Tanzu Kubernetes Grid Integrated. This means that users will have access to new features available only through NSX-T policy API. This feature is currently in beta. In addition, more NSX-T and NSX Container Plug-in (NCP) configuration is possible through the network profiles. This operator command provides the benefit of being able to set configurations through the CLI, and this is persistent across lifecycle events. Storage enhancements We’ve made storage operations in our customers’ container native environments easier, too. Customers were seeking a simpler and more secure way to manage Container Storage Interface (CSI), and we introduced automatic installation of the vSphere CSI driver as a BOSH process beginning with Tanzu Kubernetes Grid Integrated 1.11. Also, as VCP will be deprecated, customers are advised to use the CSI driver. VCP-to-CSI migration is a part of Tanzu Kubernetes Grid Integrated 1.12 and is designed to help customers move forward faster. Enhanced security Implementing new technologies provides users with new capabilities, but it can also lead to new security vulnerabilities if not done correctly. VMware’s goal is to help customers move forward with ease and the confidence of knowing that enhancements don’t compromise core security needs. CIS benchmarks This year, Tanzu Kubernetes Grid Integrated continued to see improvements that help meet today’s high security standards. Meeting the Center for Internet Security (CIS) benchmarks standards is vital for Tanzu Kubernetes Grid Integrated. In recent Tanzu Kubernetes Grid Integrated releases, a few Kubernetes-related settings have been adjusted to ensure compliance with CIS requirements: Kube-apiserver with --kubelet-certificate-authority settings (v1.12) Kube-apiserver with --authorization-mode argument includes Node (v1.12) Kube-apiserver with proper --audit-log-maxage argument (v1.13) Kube-apiserver with proper --audit-log-maxbackup argument (v1.13) Kube-apiserver with proper --audit-log-maxsize argument (v1.13) Certificate rotations Tanzu Kubernetes Grid Integrated secures all communication between its control plane components and the Kubernetes clusters it manages, using TLS validated by certificates. The certificate rotations have been simplified in recent releases. Customers can now list and simply update certificates on a cluster-by-cluster basis through the “tkgi rotate-certificates” command. The multistep, manual process was replaced with a single CLI command to rotate NSX-T certificates (available since Tanzu Kubernetes Grid Integrated 1.10) and cluster-by-cluster certificates (available since Tanzu Kubernetes Grid Integrated 1.12). Hardening of images Tanzu Kubernetes Grid Integrated keeps OS images, container base images, and software library versions updated to remediate the CVEs reported by customers and in the industry. It also continues to use the latest Ubuntu Xenial Stemcell latest versions for node virtual machines. With recent releases and patch versions, the version of dockerd, containerd, runc, telegraf, nfs-utils had been bumped to the latest stable and secure versions as well. By using Harbor as a private registry management service, customers could also leverage the built-in vulnerability scan features to discover the application images CVEs. VMware is dedicated to supporting customers with production readiness by enhancing the user experience. Tanzu Kubernetes Grid Integrated Edition has stayed up to date with the Kubernetes community and provides customers with the support and resources they need to innovate rapidly.

Read More
Server Virtualization

Addressing Multi-Cloud Complexity with VMware Tanzu

Article | May 17, 2023

Introduction With cloud computing on the path to becoming the mother of all transformations, particularly in IT's ways of development and operations, we are once again confronted with the problem of conversion errors, this time a hundredfold higher than previous moves to dispersed computing and the web. While the issue is evident, the remedies are not so obvious. Cloud complexity is the outcome of the fast acceleration of cloud migration and net-new innovation without consideration of the complexity this introduces in operations. Almost all businesses are already working in a multi-cloud or hybrid-cloud environment. According to an IDC report, 93% of enterprises utilize multiple clouds. The decision could have stemmed from a desire to save money and avoid vendor lock-in, increase resilience, or businesses might have found themselves with several clouds as a result of the compounding activities of different teams. When it comes to strategic technology choices, relatively few businesses begin by asking, "How can we secure and control our technology?" Must-Follow Methods for Multi-Cloud and Hybrid Cloud Success Data Analysis at Any Size, from Any Source: To proactively recognize, warn, and guide investigations, teams should be able to utilize all data throughout the cloud and on-premises. Insights in Real-Time: Considering the temporary nature of containerized operations and functions as a service, businesses cannot wait minutes to determine whether they are experiencing infrastructure difficulties. Only a scalable streaming architecture can ingest, analyze, and alert rapidly enough to discover and investigate problems before they have a major impact on consumers. Analytics That Enables Teams to Act: Because multi-cloud and hybrid-cloud strategies do not belong in a single team, businesses must be able to evaluate data inside and across teams in order to make decisions and take action swiftly. How Can VMware Help in Solving Multi-Cloud and Hybrid-Cloud Complexity? VMware made several announcements indicating a new strategy focused on modern applications. Their approach focuses on two VMware products: vSphere with Kubernetes and Tanzu. Since then, much has been said about VMware's modern app approach, and several products have launched. Let's focus on VMware Tanzu. VMware Tanzu Tanzu is a product that enables organizations to upgrade both their apps and the infrastructure that supports them. In the same way that VMware wants vRealize to be known for cloud management and automation, Tanzu wants to be known for modern business applications. Tanzu uses Kubernetes to build and manage modern applications. In Tanzu, there is just one development environment and one deployment process. VMware Tanzu is compatible with both private and public cloud infrastructures. Closing Lines The important point is that the Tanzu portfolio offers a great deal of flexibility in terms of where applications operate and how they are controlled. We observe an increase in demand for operating an application on any cloud, and how VMware Tanzu assists us in streamlining the multi-cloud operation for MLOps pipeline. Apart from multi-cloud operation, it is critical to monitor and alarm each component throughout the MLOps lifecycle, from Kubernetes pods and inference services to data and model performance.

Read More
VMware, Vsphere, Hyper-V

Digital Marketplace: The Future of E-commerce

Article | May 2, 2023

It is no surprise that e-commerce has grown dramatically in recent years. I don't want to be boring, but certainly the pandemic and a few other market factors have had a role. From ancient times, marketplaces of all shapes and sizes have served as the foundation for all types of business. As the world transforms and becomes more digital, the rise of digital marketplaces, e-commerce, and other types of online business is exploding. E-commerce marketplace platforms are rapidly expanding in the digital environment and are expected to acquire momentum as the future of e-commerce. This increase is because of the fact that online marketplaces combine user demand and provide customers with a broader selection of products. Digital Marketplaces Are the Way to the Future of E-Commerce Without a doubt, online marketplaces will dominate the e-commerce business in the coming years. According to Coresight Research, marketplace platform revenue will more than double, reaching around $40 billion in 2022. This means that by 2022, online marketplaces will account for 67% of worldwide e-Commerce revenues (Forrester). Today, the issue is not whether you sell online but how far you can reach. E-commerce offers limitless opportunities, and all you need to do is keep pace with the trends. What are you doing right now? How far can you go? Have you already made the transition from local to global? Digital marketplaces are indeed the way of the future of e-commerce. The earlier you realize this and integrate it into your sales and marketing approach, the better. I really mean it. The world is changing, and your competitors are not sleeping. You cannot overlook this trend if you really want to stay ahead. It's all about the people in business, as it has always been. Understanding who you're pitching to is critical to your success. You should be aware. Everything you do in business should get you closer to your target audience. Closing Lines: Digital marketplaces are indeed the future of commerce. People will inevitably start shopping online even more in the future. That implies methods and means will be developed to make such transactions easier for the common individual. Explore how your business might profit from these markets and trends that suggest the future of physical and online shopping.

Read More
Virtual Desktop Tools, Virtual Desktop Strategies

VM Applications for Software Development and Secure Testing

Article | June 8, 2023

Contents 1. Introduction 2. Software Development and Secure Testing 3. Using VMs in Software Development and Secure Testing 4. Conclusion 1. Introduction “Testing is an infinite process of comparing the invisible to the ambiguous in order to avoid the unthinkable happening to the anonymous.” —James Bach. Testing software is crucial for identifying and fixing security vulnerabilities. However, meeting quality standards for functionality and performance does not guarantee security. Thus, software testing nowadays is a must to identify and address application security vulnerabilities to maintain the following: Security of data history, databases, information, and servers Customers’ integrity and trust Web application protection from future attacks VMs provide a flexible and isolated environment for software development and security testing. They offer easy replication of complex configurations and testing scenarios, allowing efficient issue resolution. VMs also provide secure testing by isolating applications from the host system and enabling a reset to a previous state. In addition, they facilitate DevOps practices and streamline the development workflow. 2. Software Development and Secure Testing Software Secure Testing: The Approach The following approaches must be considered while preparing and planning for security tests: Architecture Study and Analysis: Understand whether the software meets the necessary requirements. Threat Classification: List all potential threats and risk factors that must be tested. Test Planning: Run the tests based on the identified threats, vulnerabilities, and security risks. Testing Tool Identification: For software security testing tools for web applications, the developer must identify the relevant security tools to test the software for specific use cases. Test-Case Execution: After performing a security test, the developer should fix it using any suitable open-source code or manually. Reports: Prepare a detailed test report of the security tests performed, containing a list of the vulnerabilities, threats, and issues resolved and the ones that are still pending. Ensuring the security of an application that handles essential functions is paramount. This may involve safeguarding databases against malicious attacks or implementing fraud detection mechanisms for incoming leads before integrating them into the platform. Maintaining security is crucial throughout the software development life cycle (SDLC) and must be at the forefront of developers' minds while executing the software's requirements. With consistent effort, the SDLC pipeline addresses security issues before deployment, reducing the risk of discovering application vulnerabilities while minimizing the damage they could cause. A secure SDLC makes developers responsible for critical security. Developers need to be aware of potential security concerns at each step of the process. This requires integrating security into the SDLC in ways that were not needed before. As anyone can potentially access source code, coding with potential vulnerabilities in mind is essential. As such, having a robust and secure SDLC process is critical to ensuring applications are not subject to attacks by hackers. 3. Using VMs in Software Development and Secure Testing: Snapshotting: Snapshotting allows developers to capture a VM's state at a specific point in time and restore it later. This feature is helpful for debugging and enables developers to roll back to a previous state when an error occurs. A virtual machine provides several operations for creating and managing snapshots and snapshot chains. These operations let users create snapshots, revert to any snapshots in the chain, and remove snapshots. In addition, extensive snapshot trees can be created to streamline the flow. Virtual Networking: It allows virtual machines to be connected to virtual networks that simulate complex network topologies, allowing developers to test their applications in different network environments. This allows expanding data centers to cover multiple physical locations, gaining access to a plethora of more efficient options. This empowers them to effortlessly modify the network as per changing requirements without any additional hardware. Moreover, providing the network for specific applications and needs offers greater flexibility. Additionally, it enables workloads to be moved seamlessly across the network infrastructure without compromising on service, security, or availability. Resource Allocation: VMs can be configured with specific resource allocations such as CPU, RAM, and storage, allowing developers to test their applications under different resource constraints. Maintaining a 1:1 ratio between the virtual machine processor and its host or core is highly recommended. It's crucial to refrain from over-subscribing virtual machine processors to a single core, as this could lead to stalled or delayed events, causing significant frustration and dissatisfaction among users. However, it is essential to acknowledge that IT administrators sometimes overallocate virtual machine processors. In such cases, a practical approach is to start with a 2:1 ratio and gradually move towards 4:1, 8:1, 12:1, and so on while bringing virtual allocation into IT infrastructure. This approach ensures a safe and seamless transition towards optimized virtual resource allocation. Containerization within VMs: Containerization within VMs provides an additional layer of isolation and security for applications. Enterprises are finding new use cases for VMs to utilize their in-house and cloud infrastructure to support heavy-duty application and networking workloads. This will also have a positive impact on the environment. DevOps teams use containerization with virtualization to improve software development flexibility. Containers allow multiple apps to run in one container with the necessary components, such as code, system tools, and libraries. For complex applications, both virtual machines and containers are used together. However, while containers are used for the front-end and middleware, VMs are used for the back-end. VM Templates: VM templates are pre-configured virtual machines that can be used as a base for creating new virtual machines, making it easier to set up development and testing environments. A VM template is an image of a virtual machine that serves as a master copy. It includes VM disks, virtual devices, and settings. By using a VM template, cloning a virtual machine multiple times can be achieved. When you clone a VM from a template, the clones are independent and not linked to the template. VM templates are handy when a large number of similar VMs need to be deployed. They preserve VM consistency. To edit a template, convert it to a VM, make the necessary changes, and then convert the edited VM back into a new template. Remote Access: VMs can be accessed remotely, allowing developers and testers to collaborate more effectively from anywhere worldwide. To manage a virtual machine, follow these steps: enable remote access, connect to the virtual machine, and then access the VNC or serial console. Once connected, full permission to manage the virtual machine is granted with the user's approval. Remote access provides a secure way to access VMs, as connections can be encrypted and authenticated to prevent unauthorized access. Additionally, remote access allows for easier management of VMs, as administrators can monitor and control virtual machines from a central location. DevOps Integration: DevOps is a collection of practices, principles, and tools that allow a team to release software quickly and efficiently. Virtualization is vital in DevOps when developing intricate cloud, API, and SOA systems. Virtual machines enable teams to simulate environments for creating, testing, and launching code, ultimately preserving computing resources. While commencing a bug search at the API layer, teams find that virtual machines are suitable for test-driven development (TDD). Virtualization providers handle updates, freeing up DevOps teams, to focus on other areas and increasing productivity by 50 –60%. In addition, VMs allow for simultaneous testing of multiple release and patch levels, improving product compatibility and interoperability. 4. Conclusion The outlook for virtual machine applications is highly promising in the development and testing fields. With the increasing complexity of development and testing processes, VMs can significantly simplify and streamline these operations. In the future, VMs are expected to become even more versatile and potent, providing developers and testers with a broader range of tools and capabilities to facilitate the development process. One potential future development is integrating machine learning and artificial intelligence into VMs. This would enable VMs to automate various tasks, optimize the allocation of resources, and generate recommendations based on performance data. Moreover, VMs may become more agile and lightweight, allowing developers and testers to spin up and spin down instances with greater efficiency. The future of VM applications for software development and security testing looks bright, with continued innovation and development expected to provide developers and testers with even more powerful and flexible tools to improve the software development process.

Read More

Spotlight

Axion

Axion is a leading IT Services, Internet Service Provider, & Federal Contracting firm based just 40 miles from Kansas City in beautiful Warrensburg, Missouri. We support clients within 60 mi. of Warrensburg. Our clients range from 2 person startups with big and innovative ideas, to organizations like the United States Department of Homeland Security. We offer a full menu of services including IT support, IT Consulting, Dedicated Internet, Application Development, Managed IT Services (email, hosting, server virtualization), network design and installation, cloud services and migration, and IT purchasing. We are a one-stop shop for anything IT and we don’t do “ticketing”. Every contact is personal, every root cause is analyzed, and no project is impossible.

Related News

GDPR and beyond The past, present and future of data privacy

siliconangle.com | July 08, 2019

There is a GDPR framework,Venkatraman explained. You start by classifying data. Then you apply specific policies to ensure you protect and back up the personal data. And then you go about meeting the specific requirements.GDPR has changed the data game, putting security and privacy on the front page, as well as on the boardroom agenda. IDC research has shown that data protection is a key influencer in IT investment decisions, with companies asking, How do I become data driven without compromising on security and sovereignty and data locality? Venkatraman stated. Actifios copy data virtualization can help companies achieve that goal, giving them the potential for a successful future, according to Venkatraman. Companies are moving from protecting data centers to protecting centers of data,Venkatraman predicted. If Actifio can help organizations protect multiple centers of data through a unified pane of glass and have that platform approach to data management, then they can help organizations become data thrivers, which gives them the competitive advantage.

Read More

IP Multimedia Subsystem (IMS) Services Market 2019 Dynamics, Comprehensive Analysis, Business Growth

worldanalytics24.com | July 08, 2019

The report provides an overview of the IP Multimedia Subsystem (IMS) Services Market industry including definitions, division, key vendors, key Development and market challenges. The IP Multimedia Subsystem (IMS) Services Market analysis is provided the international markets including development trends, competitive landscape analysis, and key regions development statusThrough the statistical analysis, the report depicts the global IP Multimedia Subsystem (IMS) Services Market including capacity, production, production value, cost/profit, supply/demand and import/export. The entire market is further distributed by company, by country, and by application/type for the competitive landscape analysis. However, security concerns in virtualization, lack of availability of a skilled workforce, may hamper the growth of the market, but for a specific period.

Read More

Datacentre Network Architecture Sales Forecasts Reveal Positive Growth Through 2026

gemnewz | July 08, 2019

This detailed presentation on Datacentre Network Architecture market accumulated by Persistence Market Research features an exhaustive study conveying influential trends prevailing in the global business sphere. The report also presents significant details concerning market size, market share and profit estimations to offer an ensemble prediction about this business. Moreover, this report undertakes an accurate competitive analysis emphasizing growth strategies espoused by market leaders.The increase in data volume, need of storage, backup, archive and also the requirement data management create complexity in datacentres. These complexities are resolved through appropriate network architecture across the datacentres. The datacentre network architecture minimize the impact of disaster scenarios and it also provides tools for data recovery. Most of the enterprises consider the datacentre network architecture is an important element of organization strategy for regulatory compliance and protection and management of company and customer data.Emergence of software defined networking (SDN), network overlay technologies, network virtualization (NV), and efficient systems have been forcing many companies to move towards next generation datacentre networks. These emerging technologies will support software-defined data centre (SDDC) and also help to virtualize the network across all the datacentre It has been observed that most of the VMware customers are moving towards network virtualization to transform their datacentre from the client/server era to the mobile/cloud era.

Read More

GDPR and beyond The past, present and future of data privacy

siliconangle.com | July 08, 2019

There is a GDPR framework,Venkatraman explained. You start by classifying data. Then you apply specific policies to ensure you protect and back up the personal data. And then you go about meeting the specific requirements.GDPR has changed the data game, putting security and privacy on the front page, as well as on the boardroom agenda. IDC research has shown that data protection is a key influencer in IT investment decisions, with companies asking, How do I become data driven without compromising on security and sovereignty and data locality? Venkatraman stated. Actifios copy data virtualization can help companies achieve that goal, giving them the potential for a successful future, according to Venkatraman. Companies are moving from protecting data centers to protecting centers of data,Venkatraman predicted. If Actifio can help organizations protect multiple centers of data through a unified pane of glass and have that platform approach to data management, then they can help organizations become data thrivers, which gives them the competitive advantage.

Read More

IP Multimedia Subsystem (IMS) Services Market 2019 Dynamics, Comprehensive Analysis, Business Growth

worldanalytics24.com | July 08, 2019

The report provides an overview of the IP Multimedia Subsystem (IMS) Services Market industry including definitions, division, key vendors, key Development and market challenges. The IP Multimedia Subsystem (IMS) Services Market analysis is provided the international markets including development trends, competitive landscape analysis, and key regions development statusThrough the statistical analysis, the report depicts the global IP Multimedia Subsystem (IMS) Services Market including capacity, production, production value, cost/profit, supply/demand and import/export. The entire market is further distributed by company, by country, and by application/type for the competitive landscape analysis. However, security concerns in virtualization, lack of availability of a skilled workforce, may hamper the growth of the market, but for a specific period.

Read More

Datacentre Network Architecture Sales Forecasts Reveal Positive Growth Through 2026

gemnewz | July 08, 2019

This detailed presentation on Datacentre Network Architecture market accumulated by Persistence Market Research features an exhaustive study conveying influential trends prevailing in the global business sphere. The report also presents significant details concerning market size, market share and profit estimations to offer an ensemble prediction about this business. Moreover, this report undertakes an accurate competitive analysis emphasizing growth strategies espoused by market leaders.The increase in data volume, need of storage, backup, archive and also the requirement data management create complexity in datacentres. These complexities are resolved through appropriate network architecture across the datacentres. The datacentre network architecture minimize the impact of disaster scenarios and it also provides tools for data recovery. Most of the enterprises consider the datacentre network architecture is an important element of organization strategy for regulatory compliance and protection and management of company and customer data.Emergence of software defined networking (SDN), network overlay technologies, network virtualization (NV), and efficient systems have been forcing many companies to move towards next generation datacentre networks. These emerging technologies will support software-defined data centre (SDDC) and also help to virtualize the network across all the datacentre It has been observed that most of the VMware customers are moving towards network virtualization to transform their datacentre from the client/server era to the mobile/cloud era.

Read More

Events