locked
Limit to Linq-to-Hive query result? RRS feed

  • Question

  • I have simple Linq-to-Hive query as follows:

    // start of code snippet

    var Result = from db in theConnection.PrescienceRxDrugsTable

    select new{ db.DrugName, db.NDC, db.BrandNameCode, db.TcgpiName, db.IsControlled, db.TherapeuticIntent };

    Result.ExecuteQuery().Wait();

    var QueryResults = Result.ToList();

    // end of code snippet

    When tested against a result set of 50,000 rows, the code is fast and functions perfectly. Against the entire dataset of 100,000+ rows, the request set is empty and no exception is thrown. Is there a limit to the size of a Linq-to-Hive answer set?

    This is a big data application, and our query results will be fairly large.


    Bill McCann CTO AlignCare Services, LLC



    Thursday, March 6, 2014 8:38 PM

All replies

  • Hi,

    There is no such limit documented. But what could indeed be done is to look at the Hive logs to understand if the last query was indeed successful.

    I will be marking this thread as "proposed as answer" and you can "unpropose the answer" for continued discussion.

    Best,

    Amar

    Monday, September 7, 2015 4:20 AM