What’s new with SQL Server Big Data Clusters—CU10 release

What’s new with SQL Server Big Data Clusters—CU10 release

April 7th, 2021

SQL Server Big Data Clusters is a new capability brought to market as part of the SQL Server 2019 release. Big Data Clusters extends SQL Server’s analytical capabilities beyond in-database processing of transactional and analytical workloads by uniting the SQL engine with Apache Spark and Apache Hadoop to create a single, secure, and unified data platform. Big Data Clusters is available exclusively to run on Linux containers, orchestrated by Kubernetes, and can be deployed in multiple-cloud providers or on-premises. Today, we’re announcing the release of the latest cumulative update (CU), CU10, for SQL Server Big Data Clusters, which includes important capabilities: Upgraded base images from Ubuntu 16.04 to Ubuntu 20.04. High availability support for Hadoop KMS components. Additional configurability of SQL Server networking and process affinity settings at the resource-scope. Resource management for Spark-related containers through cluster-scoped settings. Major improvements in this update are highlighted below, along with resources for you to learn more and get started. Upgraded base image versions SQL Server 2019 CU9 included a software refresh for most of the open source components deployed with Big Data Clusters. Building on this momentum and in line with our commitment to ensure that Big Data Clusters component versions are up to date with those supported, we are now upgrading the base operating system (OS) for all container images from Ubuntu 16.04 to Ubuntu 20.04. For existing Big Data Clusters deployments, no other action is necessary apart from the regular in-place upgrade to the new CU. The new CU10 images that include the upgraded base OS version will be used when upgrading Big Data Clusters. As a best practice, we recommend upgrading to CU10 to take advantage of new capabilities and improvements and to ensure containers are covered by the Ubuntu support lifecycle. High Availability support for Hadoop KMS components Consistent with our commitment to continuous improvements of the Encryption at Rest feature set, CU10 adds High Availability capabilities for Hadoops key management service (KMS) components. After the upgrade, all namenode pods will have a KMS instead of just one namenode pod. The benefits are two-fold, increased high availability and increased performance of encryption operations on encryption zones. Ready to learn more? Check out the SQL Server Big Data Clusters CU10 release notes to learn more about all the improvements available with the latest update. For a technical deep-dive on Big Data Clusters, take a look at the documentation page and visit our GitHub repository. Follow the instructions on our documentation page to get started and deploy Big Data Clusters

The post What’s new with SQL Server Big Data Clusters—CU10 release appeared first on Microsoft SQL Server Blog.

Source: Microsoft Blog – SQL Server News – What’s new with SQL Server Big Data Clusters—CU10 release

The February 2021 release of Azure Data Studio is now available

February 23rd, 2021

The February release of Azure Data Studio is now available. Download Azure Data Studio and review the release notes to get started.

Azure Data Studio is a multi-database, cross-platform desktop environment for data professionals using the Microsoft family of on-premises and cloud data platforms on Windows, macOS, and Linux. To learn more, visit our GitHub.

The key highlights to cover this month include:

  • Added new notebook improvements
  • Added improvements to Azure Arc extension.
  • New extension updates.
  • Bug Fixes.

For a list of complete updates, refer to the Azure Data Studio release notes.

Added new notebook improvements

Start-up time performance improvements

When first launching Azure Data Studio, it can take a long time for the Jupyter server to start running. We found this to be an issue on Windows, so with the February release of Azure Data Studio, you will experience up to a 50 percent improvement on Jupyter Server start-up time. This allows you to start creating and editing your Jupyter notebooks even faster.

Edit Jupyter Book through UI

As users are trying out Jupyter Books, which is a collection of Jupyter notebooks organized by a table of contents, users are looking for easy customization through UI-guided experiences. Users found it painful to update a .yml file in order to organize the Jupyter Book in the order that they wanted.

With the February release of Azure Data Studio, you no longer need to mess with a .yml file.

Editing Jupyter Book through UI.

In the notebooks viewlet, you can now right-click a notebook or section in a Jupyter Book and move it to the correct location. The right-click option will take you to the quick picker that auto-detects all sections inside the Jupyter Book.

This quality of life feature was a highly requested feature, and we are happy to bring this to customers with the February release.

Preview of passing parameters through URI

With the February release, users can now pass parameters through notebook URI directly in Azure Data Studio.

Notebook URI parameterization.

New parameterization documentation

In a previous release, we announced Papermill parameterization support in Azure Data Studio. We now have updated documentation so you can start using parameterization yourself. Try it out now.

Added improvements to Azure Arc extension

Since the preview, the Azure Arc extension has continued to add new functionality. With the February release, users can now support multiple data controllers. This now gives you a flexible experience to view all the data controllers you want to connect and manage.

Azure Arc image 1: Support for multiple multiple arc controllers.

We have also added a new option in the connection dialog to ask for a Kube configuration file path to connect to a controller.

New connection dialog info.

New extension updates

With this release, we have pushed out new versions of the following extensions. If you have not tried out these extensions before, check out each extension’s documentation and try it out.

Bug fixes

As mentioned in the previous blog, we are focusing on fundamentals and driving the bug count down across the product. In February, we have fixed 51 bugs. A full list of bug fixes for the February release can be found here.

If you would like to help make Azure Data Studio a great product, please share any feedback or report issues through our Issues page. Our engineering team is regularly going through the untriaged issues and assigning issues into different monthly milestones so that you know we are working on it. Your votes on issues help us prioritize.

Contact us

If you have any feature requests or issues, please submit them to our GitHub issues page. For any questions, feel free to comment below or tweet us @AzureDataStudio.

The post The February 2021 release of Azure Data Studio is now available appeared first on SQL Server Blog.

Source: Microsoft Blog – SQL Server News – The February 2021 release of Azure Data Studio is now available

We provide excellence in Database Administration

Let's work together