Unlocking the Potential of Deep Learning with Virtualized AI

Run:AI | April 22, 2020

  • A virtualized AI infrastructure for DL would run a single workload on multiple shared physical resources.

  • Article by Google’s Francois Chollet discusses the skill acquisition-based approach to gathering intelligence.

  • The conventional computing stack – from processor to firmware to virtualization, abstraction, orchestration and operating layers through to end-user software.


Is the recent progress in deep learning true artificial intelligence? A widely-discussed article by Google’s Francois Chollet discusses the skill acquisition-based approach to gathering intelligence – the one currently in use in modern DL. He argues that with huge data sets available for training models, AI is mastering skill-acquisition but not necessarily the “scope, generalization difficulty, priors, and experience” that true AI should incorporate. Even with our progress in AI, and specifically DL, we are nowhere near the limits of what DL can achieve with bigger, better-trained more accurate models, those that take into account not only skill but experience, and generalization of that experience.

Understandably, this has put intense focus on computing power, particularly the hardware that enables data scientists to run complex training experiments.

 

Nvidia increasing sees DL as a key market for its GPUs and bought Mellanox to speed communication inside a GPU cluster. With its recent acquisition of Habana, Intel is likely betting that custom AI accelerator hardware is a better match.


Other AI-first hardware includes Cerebras’s massive chip in a custom box that’s designed for the specific types of intensive, long-running workloads that training DL models require. In the cloud, Google’s Tensor Processing Units offer another bespoke option.

For companies running their own DL workloads, more compute is generally better. Whether exotic AI accelerators or tried-and-tested GPUs, quicker model training means more iterations, faster innovation and reduced time-to-market. It may even mean we can achieve “strong” AI (i.e., AI than goes beyond “narrow AI,” which is the capability of doing a single, discrete task) quicker.

 

In 2020, continuing the trend of recent years, companies will invest in ever-more AI hardware, in an effort to satisfy data scientists’ demands for compute to run bigger models to solve more complex business problems. But hardware isn’t the whole picture.


The conventional computing stack – from processor to firmware to virtualization, abstraction, orchestration and operating layers through to end-user software – was designed for traditional workloads, prioritizing high-availability, short-duration operations.Training a DL model, though, is the opposite of this sort of workload. While running a model, an experiment may need 100 percent of all the computing power of one or multiple processors for hours or even days at a time.

Read more: Virtualization can transform your company’s IT infrastructure

Spotlight

This video is about virtual machines configured in VMware workstation which are giving error while trying to power on virtual machines. For this you need to go the run command and type "services.msc". Now, a window will prompt up with lot of services. You need to select the VMware Authentication service and then restart it . Then try to power on the virtual machine it will start booting.

Spotlight

This video is about virtual machines configured in VMware workstation which are giving error while trying to power on virtual machines. For this you need to go the run command and type "services.msc". Now, a window will prompt up with lot of services. You need to select the VMware Authentication service and then restart it . Then try to power on the virtual machine it will start booting.

Related News

VMWARE

VMware and eero, an Amazon Company, to Deliver Whole-Home Wi-Fi to Remote Workers

VMware | November 01, 2021

VMware Inc. announced it will collaborate with eero, an Amazon company, on work-from-home capabilities that will boost remote network connectivity while extending critical security services to devices connecting to an at-home corporate network. Designed for work-from-home employees in the U.S. and delivered by strategic channel partners, the collaboration is designed to pair eero 6 series mesh Wi-Fi systems with VMware SASE Work from Home solution. In addition, as part of this agreement, VMware is announcing eero is a preferred Wi-Fi provider. “We ask a lot of our home Wi-Fi these days. At any given moment it may be supporting multiple data-intensive tasks: from joining a work video-conference call, to streaming and gaming in 4K, to supporting an online learning environment, and more. When your network is stretched too thin, your work-from-home performance can suffer,” said Sean Harris, vice president of sales and marketing, eero. “Through this collaboration with VMware, we’re able to offer fast, reliable, and more secure Wi-Fi for remote workers.” Deploying VMware and eero solutions together will enable IT teams to extend a better at-home Wi-Fi experience for their employees, working alongside VMware’s solution to deliver cloud networking and cloud security services. Channel partners will be able to offer customers a solution that brings together: eero 6 series mesh Wi-Fi systems featuring Wi-Fi 6: Employees need not be limited to working from one location in the home. eero 6 series mesh Wi-Fi systems feature Wi-Fi 6, delivering fast speeds and solid coverage for simultaneous device usage throughout the home so employees will be able to say goodbye to dead spots in the home and enjoy strong app performance. Employers will have the option to offer eero Pro 6, a tri-band, high-performance mesh Wi-Fi 6 router designed for homes with Gigabit internet connections, or eero 6, a dual-band mesh Wi-Fi 6 router designed for homes with internet connections up to 500 Mbps. With eero Secure, employees will receive an added layer of security for their home Wi-Fi, including parental controls for safe search, content filters, advanced security preventing access to sites flagged as malicious, ad blocking to protect their privacy and speed up their browsing experience, and now data usage insights to better manage time online. VMware SASE is a cloud-hosted solution that will help enable more secure, reliable, and efficient connectivity between user traffic from the eero Wi-Fi network in the home to the applications in public cloud, SaaS cloud and on-premises data centers. VMware SASE brings dynamic remediation capabilities when broadband networks experience packet loss, latency, and jitter. The solution recognizes over 3,000 apps automatically, and intelligently prioritizes business-critical application traffic, providing a better user experience. The solution handles latency-sensitive, real-time traffic like audio, video, VDI and IoT, providing a low-latency optimal path using a global network of SASE Points of Presence (PoPs) close to the eero Wi-Fi users. These PoPs are strategically placed at the doorstep of major SaaS and IaaS providers to offer under 15 milliseconds of latency between users and their applications in the majority of deployments. For IT teams, VMware SASE helps deliver operational simplicity leveraging the centralized Orchestrator to drive networking and security policies. IT can configure these policies and push them to all the remote sites powered by eero Wi-Fi systems. In addition, VMware SASE uses AIOps to give IT teams the visibility they need to determine the actual user experience when users access cloud applications. The solution compares performance benchmarks between different sites and identifies opportunities for improvement. The solution is not limited to simply identifying and analyzing issues, it also helps remediate these issues proactively with a path to self-healing. “This collaboration brings together two work-from-home technology leaders. We share a common vision to have technology be an enabler of a great remote work experience rather than an obstacle. Our technologies have played a critical role in empowering remote workers everywhere and we look forward to bringing our capabilities together to deliver a differentiated mesh Wi-Fi solution to our customers.” Craig Connors, vice president and CTO, Service Provider and Edge, VMware About VMware VMware is a leading provider of multi-cloud services for all apps, enabling digital innovation with enterprise control. As a trusted foundation to accelerate innovation, VMware software gives businesses the flexibility and choice they need to build the future. Headquartered in Palo Alto, California, VMware is committed to building a better future through the company’s 2030 Agenda.

Read More

VIRTUAL SERVER INFRASTRUCTURE

Comcast Announces World-First Test of 10G Modem Technology Capable of Delivering Multigigabit Speeds to Homes

Comcast Corporation | January 17, 2022

Comcast announced the successful test of a prototype 10G modem using the core technology that will deliver multigigabit speeds to tens of millions of homes. In a world-first lab test, a Full Duplex DOCSIS 4.0 system-on-chip (SoC) cable modem built by Broadcom delivered upload and download speeds faster than 4 gigabits per second (Gbps) powered by 10G network technology. The announcement is the latest in a series of 10G milestones from Comcast. In October 2021, the company announced a successful test of a complete 10G connection using a virtualized cable modem termination system (vCMTS) powered by DOCSIS 4.0 technology. That announcement followed major 10G milestone announcements in April 2021, of the first-ever live lab test of a 10G system-on-chip (SOC) and October 2020, of a trial delivering 1.25 gigabit-per-second (Gbps) upload and download speeds over a live production network using Network Function Virtualization (NFV) combined with the latest DOCSIS technology. A key component of 10G, DOCSIS 4.0 is an evolutionary leap forward in the ability to deliver multigigabit upload and download speeds over the connections already installed in hundreds of millions of homes worldwide. The great strength of our smart network design is that we are able to exceed our customers’ demands today, even as we continuously evolve to meet the needs of the future. As our 10G journey continues to accelerate, customers will reap the benefits of ever-increasing security, reliability, and speed.” Charlie Herrin, President of Technology, Product, Experience at Comcast Cable 10G technology builds on the work Comcast has done over the past several years to build a smarter, more virtualized network. In addition to providing a path to multigigabit upload and download speeds at scale, 10G updates will deliver near-term benefits to customers in the form of increased reliability, performance, and lower latency. Connected by Broadcom 10G technology, the modem test utilized the DOCSIS 4.0 FDX SoC device, which Comcast demonstrated in April 2021, to pair with two cable modem chips to deliver the breakthrough performance. These were successfully connected over a lab-based hybrid fiber-coaxial network to the vCMTS operating in DOCSIS 4.0 mode. This represents the first complete network connection of all-DOCSIS 4.0 components that are required for deployment. The demonstrated speeds – which were faster than 4 Gbps upload and download – are expected to increase significantly as developers refine technology at every level of the 10G architecture. “With each new milestone, we get a clearer picture of how 10G technologies will unlock the next generation of speed and performance for millions of people worldwide,” said Elad Nafshi, Senior Vice President of Next Generation Access Networks at Comcast Cable. 10G is a global industry initiative to stay ahead of consumer demand by developing and deploying new network technology to dramatically increase upload and download capacity in the coming years. About Comcast Corporation Comcast Corporation is a global media and technology company that connects people to moments that matter. We are principally focused on broadband, aggregation, and streaming with over 56 million customer relationships across the United States and Europe. We deliver broadband, wireless, and video through our Xfinity, Comcast Business, and Sky brands; create, distribute, and stream leading entertainment, sports, and news through Universal Filmed Entertainment Group, Universal Studio Group, Sky Studios, the NBC and Telemundo broadcast networks, multiple cable networks, Peacock, NBCUniversal News Group, NBC Sports, Sky News, and Sky Sports; and provide memorable experiences at Universal Parks and Resorts in the United States and Asia.

Read More

VMWARE

IGEL Releases Support for VMware Workspace ONE Intelligent Hub for Linux

IGEL | December 09, 2021

IGEL, provider of the next-gen edge OS for cloud workspaces, announced support for VMware Workspace ONE Intelligent Hub for Linux, which facilitates communication between IGEL OS-powered devices and the Workspace ONE Unified Endpoint Management (UEM) console. As a result, mutual VMware and IGEL customers can now simplify device management from a single view for greater visibility and compliance of devices across the enterprise. With the development of Workspace ONE Intelligent Hub for Linux, VMware has affirmed its view of the importance of Linux devices at the endpoint. IGEL is pleased to deliver rapid support for the Workspace ONE Intelligent Hub for Linux to empower its customers with unified visibility to improve their endpoint asset management, productivity and insights. This is another landmark step in our strategic journey to deliver greater integration for VMware Horizon users as they leverage the anywhere workspace for a productive and engaging user experience." Bill McCarthy, Vice President, Business Development, IGEL Thousands of IGEL customers already use IGEL OS to securely access VMware Horizon desktops and workloads every day. The expansion of the partnership extends the value of Workspace ONE to include IGEL OS endpoints, regardless of where they are located. "IGEL is a valuable VMware partner and we are pleased to see the delivery of their support for Workspace ONE Intelligent Hub for Linux," said Jason Roszak, Vice President of Product Management, End-User Computing, VMware. "Linux devices are a strategic component in the fabric of today's enterprise environments and we are excited to empower customers that have embraced IGEL OS with a simple and more secure solution to manage their apps and devices in a single view. Using Workspace ONE Intelligence and data aggregation, our mutual customers can better manage enterprise complexity and security without compromising on user experience." "We believe there is a tremendous value that can be derived from the partnerships and alliances formed between our key vendor partners, and IGEL's collaboration with VMware and support for VMware Workspace ONE Intelligent Hub for Linux is a great example of this," said Mike Strohl, CEO, Entisys360. "Through this alliance, Entisys360 is able to grow our IGEL business further by providing our mutual customers with the ability to simply and securely manage their Workspace ONE desktops and workloads powered by IGEL OS. This unified visibility of both apps and devices improves the end user experience and overall organizational productivity, two significant challenges our customers are solving for in their IT infrastructure environments." Support for the VMware Workspace ONE Intelligent Hub for Linux will be available as a custom partition which can be deployed to IGEL OS devices allowing them to be enrolled into Workspace ONE. This enables IGEL OS and Workspace ONE to offer management capabilities that include asset management and insights for IT productivity and compliance processes. The two companies are also collaborating on cloud connector technology for IGEL Universal Management Suite (UMS) and VMware Workspace ONE UEM which will deliver increased management insights and policy-based control for VMware Horizon and IGEL users. This new IGEL development with VMware is the latest in a long-standing technology partnership between the two companies. Earlier this year, IGEL announced that its product would support VMware Horizon 2106 Microsoft Teams optimization for Linux to support high-fidelity connectivity and collaboration using IGEL OS-powered endpoints. A year ago, IGEL announced its validation of IGEL OS with VMware Horizon 8 and that it has renewed its Advanced tier membership in VMware's Technology Alliance Partner (TAP) program. VMware is also a strategic member of the IGEL Ready technology partner program which validates and verifies interoperability of solutions. About IGEL IGEL is one of the world's leading providers of next-gen edge OS for cloud workspaces. The company's innovative software products include IGEL OS, IGEL Universal Management Suite (UMS), and IGEL Cloud Gateway (ICG). These solutions comprise a more secure, manageable and cost-effective endpoint management and control platform across nearly any x86 device and some ARM/RPI4 devices. Easily acquired via just two feature-rich software offerings, — Workspace Edition and Enterprise Management Pack — IGEL software presents outstanding value per investment. IGEL enables enterprises to save vast amounts of money by extending the useful life of their existing endpoint devices while precisely controlling all devices running IGEL OS from a single dashboard interface. IGEL has offices in Europe and the United States and is represented by partners in over 50 countries.

Read More