SQL Data Warehouse
Do you have an idea or suggestion based on your experience with SQL Data Warehouse? We would love to hear it! Please take a few minutes to submit your idea or vote up an idea submitted by another SQL Data Warehouse customer. All of the feedback you share in these forums will be monitored and reviewed by the SQL Data Warehouse engineering team. By suggesting or voting for ideas here, you will also be one of the first to know when we begin work on your feature requests and when we release the feature.
Remember that this site is only for feature suggestions and ideas! If you have technical questions please try our documentation, MSDN forum, or StackOverflow. If you need support, please open a support ticket with us.
-
Replicated Table Support
The feature is similar to that of redshift's Distribution style all. This will reduce data transfer between distributions/nodes and consequently improve performance.
150 votesWe understand the need for replicated tables and are working on a design for this feature. We hope to have more to share in the coming months. 6646954
-
Database project from Visual Studio to support Azure SQL Data Warehouse
Database project from Visual Studio is useful to manage DDLs, schema compare between the project and database, etc. Please create a project template dedicated for DW or support DW development from Database Project.
127 votesWe are actively working on making all of the tools experiences better. Support for database projects in Visual Studio is part of this effort and we have begun working on the initial steps to getting this feature implemented. We will have an ETA by the end of this calendar year. 6882139
-
PolyBase: support for Azure Data Lake Store
Polybase should add support for Azure Data Lake. I'm hopeful that will give us an option to do Polybase on top of files which are encrypted at rest.
124 votesWe understand the need to support Azure Data Lake Store as an external data source with PolyBase in Azure SQL Data Warehouse for parallelized data loading/extraction. We are working on the design and hope to share more details in coming months. 8119594
-
MERGE statement support
Support the MERGE sql statement to support management of SCD1 / SCD2
123 votesThanks for your suggestion. We are looking into this scenario for a future release. 8120435
-
Add IDENTITY Types
The fact IDENTITIES and SEQUENCE Types are missing makes it very difficult to generate surrogate keys. It seems the only pattern available is to combine ROW_NUMBER() with a select max from table, which is horribly clunky and won't work if parallel treads are loading into the table.
106 votesThanks for the suggestion. We are looking into this scenario for a future release. We have recently added support for uniqueidentifier and newid() which might help in some scenarios. 8104927
-
PolyBase: allow skipping header rows in delimited text files
Setting reject rows in Polybase to ignore the header row is a hack. And if you have all string columns your header won't be rejected. Please add an IGNORE_HEADER_ROWS = <numRows> option to Polybase
85 votesThanks for your suggestion. We are looking into this scenario for a future release. 6891051
-
Row-Level Security
It would be great to implement Row-Level Security on SQL Data Warehouse.
That would be a great solution for scenarios where (for example) we have clients like PowerBI using data from SQL warehouse, and persons who have limited data access.70 votesThanks for the suggestion. Row-level security is an important security feature for DW workloads. We hope to have more to share in the coming months. 6853066
-
PolyBase: allow escaping string delimiters within string fields
If you want to quote the string columns, and if one of the quoted columns has a quote character in it, the proper way to encode this is to double the quote character. (Build a CSV file in Excel and you will see that's how it saves it. I would say Excel is the authority on CSV formats.)
it appears it's impossible for Polybase to properly load that file. For example the following format is not interpreted right with STRING_DELIMITER = '"' since it divides the value 2.5" into two columns
SizeDescription|SizeCode
"3.5 feet"|"3.5 ft"
"2.5 inches"|"2.5"""Please improve Polybase…
67 votesThanks for the suggestion. We are looking into this scenario for a future release. “PolyBase should allow escaping row, field and string delimiters in string fields” – 7284026.
-
SQL Data Warehouse endpoint in the Virtual Network
Currently Azure DWH is only accessible using the host name of logical SQL Server and all traffic goes through public Internet.
Would be great to have an endpoint with a reserved IP within the Virtual Network to ensure given logical SQL Server is seen as an internal resources within the corporate network.
58 votesThanks for the suggestion. We are looking into this scenario for a future release. 7291747
-
PolyBase: allow retrieving rejected rows in an error file
Let's say you define an external table with:
REJECT_VALUE = 1000,
REJECT_TYPE = valueThat means that it can reject and discard 1000 rows without failing the entire command.
Please enhance Polybase to give us visibility into which rows were rejected and why. I would propose you can define an error output file where rejected rows get written. Either that or let us query some DMV to get a copy of the complete row as a string and the error reason.
49 votesThanks for your suggestion. We are looking into this scenario for a future release. 6891260
-
Polybase: allow field/row terminators within string fields
If a line end is present within a text field (qualified) importing data using Polybase will fail.
Loading this line will work fine:
1;2.1;"zzzz"Loading this will fail:
1;2.1;"zz
zz"Code:
CREATE EXTERNAL FILE FORMAT text_file_format_raw
WITH
(
FORMAT_TYPE = DELIMITEDTEXT,
FORMAT_OPTIONS
(
FIELD_TERMINATOR =';',
STRING_DELIMITER = '0x22',
USE_TYPE_DEFAULT = TRUE
)
);CREATE EXTERNAL TABLE dbo.test_external
(
col1 INT,
col2 DECIMAL(2,1),
col3 NVARCHAR(5)
)
WITH
(
LOCATION = 'test_failing.txt',
DATA_SOURCE = azure_storage,
FILE_FORMAT = text_file_format_raw
);CREATE TABLE dbo.test
WITH (CLUSTERED COLUMNSTORE INDEX, DISTRIBUTION = ROUND_ROBIN)
AS
SELECT * FROM dbo.test_external;48 votesThanks for the suggestion. We are looking into this scenario for a future release. “PolyBase should allow escaping row, field and string delimiters in string fields” – 7284026.
-
Support for Entity Framework
Support for Entity Framework in Azure SQL Data Warehouse would allow for greater usability in general, but it would also allow for better support of other frameworks/protocols. Specifically, we have a need to serve our data through an OData feed, and Entity Framework's deferred execution would allow us to handle OData's Query Options in a much simpler way.
41 votesThanks for your suggestion. We are looking into this scenario for a future release. 8315007
-
Cross Database Querying
Enable elastic query for SQL DW - this would allow cross database query in SQL DataWarehouse.
40 votesThanks for the suggestion. We are looking into this scenario for a future release. 7558005
-
Support for spatial data type
Spatial data shlould be supported by SQL Data Warehouse the same way it is supported by SQL Server.
39 votesThanks for the suggestion. We are looking into this scenario for a future release. 6386746
-
33 votes
Thanks for your suggestion. We are looking into this scenario for a future release. 8315023
-
32 votes
Thanks for the suggestion. We are looking into this scenario for a future release. 7633493
-
data warehouse scaling
SQL Data Warehouse scale stepping should be much smaller (10 DWU or even 1 DWU), than 100 DWU!
Please fix that ASAP!
Thank you!31 votesThanks for the suggestion. We’re thinking about the use case here and how we can offer a smaller DWU data warehouse.
-
Use SELECT for setting variables (SELECT @MyVar = Col1, @MyVar1 = Col2 ...)
Because we cannot do SELECT @MyVar = Col1, we are forced to utilize the same code to execute the exact same sql, to assign multiple variables.
31 votesThanks for the suggestion. T-SQL compat with SQL Server is always a top priority. We hope to have more to share in the coming months. 7192953
-
Provide File Format to read JSON and XML data from Storage
Able to read the JSON and XML file as part of external system OR provide functionality like Extractor in Data Lake analytics so we can write our own Extractor to read respective data format.
30 votesThanks for the suggestion. We are looking into this scenario for a future release. 7633476, 7633478
-
Support for Recursive CTE
It would be great if you can add support for recursive CTEs for computing hierarchical data
28 votesThanks for your suggestion. We are looking into this scenario for a future release. 8530168
- Don't see your idea?
