Chepko Danil - Fotolia

Azure networking feature addresses latency, performance

An Accelerated Networking upgrade to Microsoft Azure reduces latency and improves performance for newer VMs, as Microsoft tries to keep pace with AWS. TEST

Microsoft's latest networking update helps stabilize workloads and accelerate packet transactions on its public cloud -- and brings a new weapon onto the latest cloud provider battlefield.

Accelerated Networking, a free service now generally available in Microsoft Azure for Windows and Linux users, uses Microsoft's move to field-programmable gate arrays (FPGAs) and can reduce latency and other networking hiccups. It's also the latest in a series of upgrades from the major public cloud providers as they emphasize their platforms' networking capabilities.

Accelerated Networking, available in all Azure regions, provides up to 30Gbps throughput by moving the Azure networking stack from the hypervisor down to the smart network interface controllers (SmartNICs). It's akin to Amazon Web Services' enhanced networking feature, which is also free and available for Linux and Windows.

IDC analyst Brad CasemoreBrad Casemore

Bypassing the hypervisor to directly interface with the NIC should boost performance and cut jitter, in addition to latency benefits, said Murali Basavaiah, co-founder and vice president of engineering at Avi Networks, which provides application load balancing on premises and in the public cloud. Elimination of CPU-tied networking reduces compute cycles and load per VM, which ultimately translates to lower cost for customers and greater overall efficiency in Microsoft's data centers.

There is a hitch to the service, however. It's currently limited to a handful of options in the D, E, F and M series of VMs, and can't be used with older VM types. Customers must also use a new NIC, which cannot be attached to an existing VM, or to an availability set if any of the VMs in the group aren't Accelerated Networking-enabled. It also can only be deployed through the Azure Resource Manager.

Applications that will benefit the most from Azure Accelerated Networking are smaller, transactional workloads ... but an instance with large packet transfers, for example, would see less latency with a virtual switch.

In a bit of good timing, Microsoft made Accelerated Networking generally available in the wake of its response to the Spectre and Meltdown chip vulnerabilities. Microsoft initially said some Azure workloads would see slower performance due to security patches but, following the patches, it said Accelerated Networking should make up the difference for those users.

Applications that will benefit the most from Azure Accelerated Networking are smaller, transactional workloads, but this new tool is not a cure all, said Scott Harvey, vice president of engineering at Atmosera, an Azure managed service provider in Beaverton, Ore. An instance with large packet transfers, for example, would see less latency with a virtual switch because it wouldn't have to map additional hops required to break down large chunks of data to accommodate the capacity limits of a physical controller.

He's also dubious of Microsoft's claims that Accelerated Networking can unilaterally address performance issues related to these chip defects. "It certainly will have its benefits, but those would be there whether Spectre and Meltdown were in play or not," Harvey said.

Cloud vendors push network improvements

Cloud providers continue to improve their platforms' networking capabilities. Services such as Accelerated Networking touch on the server-network connection, but other internal and external efforts focus on performance with entire clusters through load balancers, as well as automation through wide-area networking.

Expect more as customers push for greater continuity across multiple availability zones, either because of their multinational status or because of failover and disaster recovery demands.

"It's not only going to be the local processing and what area network interface card can provide, but it will be the broader networking capabilities," said Brad Casemore, an analyst at IDC.

Microsoft has work to do for Azure networking to achieve feature parity with AWS, Casemore said. Though it has its on-premises Azure Stack to provide hybrid capabilities, it will need a response to AWS Application Load Balancer, which lets customers use an API to create an in-house staging environment for apps going to the public cloud. The company also needs to better compete with Amazon on features and performance attributes at the application layer. (TEST 2)

Trevor Jones is a senior news writer with SearchCloudComputing and SearchAWS. Contact him at [email protected].

Dig Deeper on Google and other public cloud providers

Data Center