You can also use the generic ODBC connector to connect to additional providers using third-party ODBC drivers. PolyBase allows T-SQL queries to join the data from external sources to relational tables in an instance of SQL Server.Ī key use case for data virtualization with the PolyBase feature is to allow the data to stay in its original location and format. You can virtualize the external data through the SQL Server instance, so that it can be queried in place like any other table in SQL Server. This process minimizes the need for ETL processes for data movement.

SQL Server Analytics Platform System (PDW) (PDW), hosted in the Analytics Platform System (APS)ĭata virtualization using PolyBase feature is available in preview for Azure SQL Managed Instance, scoped to querying external data stored in files in Azure Data Lake Storage (ADLS) Gen2 and Azure Blob Storage.SQL Server 2019 (15.x) and later versions (Windows and Linux).SQL Server 2016 (13.x) and later versions (Windows).PolyBase provides these same functionalities for the following SQL products from Microsoft: This data virtualization scenario is possible with the use of PolyBase connectors. SQL Server 2022 PolyBase enhancements New to SQL Server 2022 (16.x) Preview Visit Data virtualization with Azure SQL Managed Instance to learn more. SQL Server 2022 (16.x) Preview adds new connector, S3-compatible object storage, using the S3 REST API. Some connectors separate from PolyBase services You can use both OPENROWSET and EXTERNAL TABLES to query data files in S3 compatible object storage. The S3-compatible object storage connector, as well as ADSL Gen2, and Azure Blob Storage, are no longer dependent of PolyBase services. PolyBase services must still run to support connectivity with Oracle, Teradata, MongoDB, and Generic ODBC. The PolyBase feature must still be installed on your SQL Server instance. PolyBase is now capable of querying data from Parquet files stored on S3-compatible object storage. For more information, see to Virtualize parquet file in a S3-compatible object storage with PolyBase. PolyBase is now capable of querying (read-only) data from Delta Table format stored on S3-compatible object storage, Azure Storage Account V2, and Azure Data Lake Storage Gen2.

Sql server vdi jobs