How to select certain records from Sql server based on specific interval and provide it to destination using source, sink, query, subject (all comonents)?

Question

Hi,

I was looking for an option where i can define a (Inputs) Source based on specific interval using custom Payload like collection of employee that will be build based on Data from SQL server/SQLite. This collection should be build specific interval like after every 5 seconds. 

I want to define sink which will print all the records from collection, the sink should be deployed to server as well . the further i should be able to define Subject that will be deployed, where i can bind that subject with source and sink, So for other sink we can get the same subject and source.

Please guide me if you have specific solution or sample or guide.

Thanks

Answer 1

Well ... you create a source that reads from a database at a specified interval. You'll want to use a timer for your refresh.

Does this collection of employees change that frequently that you would have to enqueue the records every five seconds? What you are trying to do doesn't really make a whole lot of sense ... what is the entire context of what you are trying to do?

---

DevBiker (aka J Sawyer)
Microsoft MVP - Sql Server (StreamInsight)

---

---

If I answered your question, please mark as answer.
If my post was helpful, please mark as helpful.

Answer 2

Thanks for your reply, Sorry for my short details,

Well i want to build a lib, which will read data from diffrent sources like (database, IO devices etc). The Data could be feteched based "On Change in Data Event" or specific (Configured) interval as well. Example would be like certain rows from Table got Updated or got inserted etc, or Sensor values got updated (E.g. Temprature changed).

So in short looking for a implementation of SQL Stream Insight where i can implement Pull and Push both the features.

So building such framework which will keep eye on input data and push that to required clients or based on subscripted clients.

So please suggest your view and reference.

Thanks ..

Answer 3

With database-centric data, you'd have to check out what the database platform supports from a pull perspective. There's several ways to do it ... with Sql Server, you could look at something like Service Broker for push notifications. It's actually better, however, to get the push notifications from whatever system is adding data to the database, if at all possible. As for a reference, I don't know of any reference adapters for this that are out in the public domain so you're going to have to build it. There are, however, several reference adapters for a database pull ... check out the StreamInsight samples on CodePlex ... and reference adapters for a push, though not from a database.

---

DevBiker (aka J Sawyer)
Microsoft MVP - Sql Server (StreamInsight)

---

---

If I answered your question, please mark as answer.
If my post was helpful, please mark as helpful.

Answer 4

Hi DevBiker,

Thanks for the comments and guidance.

Will keep posting on queries if require any help. Thanks for your support :)

Regards

Ravi