none
Regarding Continous Export behavior when target destination is down for extended period of time? RRS feed

  • Question

  • If the destination (eg: storage account) to which Continuous Export is pointed to is down for an extended period of time, I assume that Continuous Export will time out after some time.

    - Is that configurable and what is the default value?

    - Also, if the destination comes back online, how do we get Continuous Export to retry pushing that data?

    Friday, November 22, 2019 5:48 AM

Answers

  • The default is 7 days and is not configurable, though we will try to send an email alert if there is an outage:

    Once the account comes online it should automatically resume pushing data, including data buffered during the outage. Keep in mind that if you go past the 7 days or stop/start the export than you will lose data. You can add it manually via the API, but it is much better to resolve the issue with the destination.

    Tuesday, November 26, 2019 7:11 PM
    Moderator
  • I don't have an exact number for you- rates are going to depend on things like the type of storage account, whether or not the storage account is in the same region, etc. There are very few customers that are going to be pushing enough data to have the process take more than a few minutes.

    Note: This example is not a guarantee of how long it would take, but is meant to give you idea of what these services are capable of. 

    The default cap on App Insights is 100 GB per day, so over 7 days that gives us around 700 GB of data. Storage can accept data at a minimum of 5 Gbps. 700 GB of data can be ingested at that rate in just under 20 minutes.

    (700 GB of data/ .625 GB per second) / 60 seconds in a minute

    • Marked as answer by abvi78 Wednesday, November 27, 2019 4:34 PM
    Wednesday, November 27, 2019 3:50 PM
    Moderator

All replies

  • The default is 7 days and is not configurable, though we will try to send an email alert if there is an outage:

    Once the account comes online it should automatically resume pushing data, including data buffered during the outage. Keep in mind that if you go past the 7 days or stop/start the export than you will lose data. You can add it manually via the API, but it is much better to resolve the issue with the destination.

    Tuesday, November 26, 2019 7:11 PM
    Moderator
  • Thanks! A followup question: At what rate is the buffered data re-delivered when the destination comes back online (within the 7 days)? Specifically, there will be the backed up data + new data to be pushed by Continuous Export at that point.
    Tuesday, November 26, 2019 9:06 PM
  • I don't have an exact number for you- rates are going to depend on things like the type of storage account, whether or not the storage account is in the same region, etc. There are very few customers that are going to be pushing enough data to have the process take more than a few minutes.

    Note: This example is not a guarantee of how long it would take, but is meant to give you idea of what these services are capable of. 

    The default cap on App Insights is 100 GB per day, so over 7 days that gives us around 700 GB of data. Storage can accept data at a minimum of 5 Gbps. 700 GB of data can be ingested at that rate in just under 20 minutes.

    (700 GB of data/ .625 GB per second) / 60 seconds in a minute

    • Marked as answer by abvi78 Wednesday, November 27, 2019 4:34 PM
    Wednesday, November 27, 2019 3:50 PM
    Moderator