Stream Analytics
Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.
-
use SQL Azure as reference data
it would be nice to use a table in a SQL Azure DB as reference data
275 votesWhile we keep looking into ways to support Azure SQL DB as a direct source of reference data, note that this can now be achieved by using Azure Data Factory to periodically copy relevant reference data snapshots from SQL DB to blobs, ready for ongoing consumption by Stream Analytics.
-
Add a REST API call as an output (with an interface to format the call)
Lots of real time dashboard solutions allow users to push data via REST API calls and JSON payloads. Thse are services such as Power BI Dashboards, Leftronic or Actoboard (I named these because they have nice documentations that you can check for their push APIs).
Note that a killer feature would be to add an interface that allows to play a little with the format of the call and the payload, so that it can conforms to a specific API.
That and/or you can pre-configure some services to match their API structures (but please not limited to Power BI Dasboards…
198 votes -
Provide better ways to debug.
My query isn't producing any results but there's no easy way for me to figure it out. Operational logs don't help.
169 votes -
Autoscale for streaming unit
At present, Stream analytics throws memory exception when there is not enough streaming units. It should automatically scale based on the streaming unit requirement.
120 votes -
103 votes
This feature is currently in limited private preview. To participate in the private preview, please send email to askasa at microsoft
-
Support InsertOrUpdate for AzureTableStorage
If a RowKey value already exists the SendEvents fails with the following error
Remove 30 duplicate rowkey element in a partition
We need an option to update the existing row with the new data coming in.
96 votes -
Allow user defined functions in queries
For example, my IoT devices are sending Unix timestamps (1429197495) to the Azure Event Hub. I need to convert the Unix epoch into a DateTime data type that stream analytics (SA) understands. I would like to be able to do that in the SELECT part of the SA query, via a user defined function..
95 votesWe have started with the ability to create User Defined Functions.
We have JavaScript UDFs available in limited private preview currently. If you would like access to this preview program please email us at askasa at microsoft.com
Thanks!
-
Take input from DocumentDb
Currently Stream Analytics accepts data from Blob storage. Support to get data from DocumentDB should be added.
91 votes -
Input from Azure Table Storage
Input from Azure Table Storage is a much better event source than Azure Blob Storage
70 votesThose interested in Azure Tables as input, can you clarify whether you wish to use Tables as stream input or as reference data? In the latter case, you can use Azure Data Factory to take snapshots of Tables into blobs, which can then be used by Stream Analytics as reference data.
-
Stream into existing Power BI Datasets
Hey,
it would be great to have the possibility to create a dataset in PowerBi Desktop and use as output in ASA.
68 votes -
Provide PowerShell and REST API for creating Power BI output
Currently you have PowerShell and REST APIs for creating outputs, but I don't believe it supports creating a Power BI output. You can only do that via the management portal. I need to be able to do this programmatically including the authentication with Power BI during setup.
64 votes -
Call to a REST endpoint to invoke custom code
Call from my query to a REST endpoint to invoke custom code.
55 votes -
Add HDInsight (HBase) to output
Adding HDInsight (HBase) as an output for an job. HBase provides random, realtime read/write access.
50 votes -
Output to mail notification
would like to mail notification at output data appeared.
I want to develop log analytics & alert system by Stream Analytics47 votes -
Allow to read/write event data properties from/to eventhub input/output
For example when we want to duplicate data from one event hub to another (for example from production to development event hub), the only option is to copy the event data payload, but no option to copy the event data properties as well.
see http://stackoverflow.com/questions/35590255/stream-analytics-and-azure-eventhub for similar issue others had.
43 votes -
On-prem SQL as input and output
Would like to push my data from on prem SQL -> Stream analytics + ML model -> Output of ML model back to on-prem SQL table -> Host power BI on corp. By this way, any PII/HBI data can still be on-prem and other numeric data can flow via the cloud and back. If the channel from cloud to on-prem sql can be secure and easily established, it would greatly help.
42 votes -
Can we add an output to a Signalr client
Can we have stream analytics acts as a notification hub and sent results out to clients.
Use case:
Filtering incoming Event Hub events and forwarding a select few to listening clients
42 votes -
Save Job Query to Source Control
It must be possible to save the query in source control and/or as part of a Visual Studio project.
33 votesNote that this can be done using PowerShell by keeping the source of your job definitions (incl. the query) in source control and using a PS script to push definitions to the ASA service.
-
Partition output Blobs according to GROUP BY Statements
An option to partition the output Blobs according to GROUP BY Statements (or something similar) would be really useful. For example group by customer_id -> results in prefixed blob CSVs for each customer. Something like that would be greatly appreciated!
31 votesAs of 7/9, some customization on blob output is supported. See http://blogs.msdn.com/b/streamanalytics/archive/2015/07/09/support-for-custom-blob-output-path.aspx
-
31 votes
- Don't see your idea?
