locked
ASP URL - and parameters passed in RRS feed

  • Question

  • User-1056786209 posted

    Hello,

    I am trying to write a data scraping program where I will be notified if a schedule for an ice hockey tournament has changed/been modified.

    The website is  http://www.nes.com/Events.asp?MO=2

    if you then click on 2018 challenge cup link, and then you can click on the schedule tab on top it shows a schedule.

    but I noticed that it doesnt matter which event I select, the url is the same no matter what. So in my program I am unable to just\

    load the schedule URL , somehow behind the scenes it is passing the event id/number.

    Is there a way to find out what the parameter name is? and can I add it to the URL?   so in my program I can load a specific schedule?

    thanks

    Saturday, January 20, 2018 9:05 PM

All replies

  • User475983607 posted

    Is there a way to find out what the parameter name is?

    Use your browser's developer tools (F12) to view the network traffic.

    and can I add it to the URL?   so in my program I can load a specific schedule?

    The web page is POSTing to Tournaments.asp using fields; txtDivision=11&txtLevel=89.    We can't comment on your app but you can certainly POST to Tournaments.asp and get a response.

    Saturday, January 20, 2018 9:26 PM
  • User-1056786209 posted

    Thank you for the response. What about the URL http://www.nes.com/Schedule.asp which is the one actually showing the schedule?

    I do not see the 2 hidden fields you previously mentioned. how does it know the correct schedule?

    thanks again

    Saturday, January 20, 2018 9:58 PM
  • User475983607 posted

    johnpat123

    Thank you for the response. What about the URL http://www.nes.com/Schedule.asp which is the one actually showing the schedule?

    I do not see the 2 hidden fields you previously mentioned. how does it know the correct schedule?

    Again, press F12 to open the browser's developer tools and look at the network traffic.  It will openly and clearly show the fields being submitted along with the HTTP message which is a POST.

    lstRink=1&lstDivision=0&lstTeam=0

    All modern browsers have developer tools.

    https://developer.chrome.com/devtools

    Saturday, January 20, 2018 10:27 PM
  • User-1056786209 posted

    Thanks

    I will play around and look more. Currently it seems that no matter which event I click to view, they all have
    the same settings below. So currently I am still not sure how each events is specified seeing that the values below are 
    always the same

    lstRink=1&lstDivision=0&lstTeam=0
    Saturday, January 20, 2018 11:26 PM
  • User-707554951 posted

    Hi johnpat123

    You description seems a little unclear.

    johnpat123

    I am still not sure how each events is specified seeing that the values below are 
    always the same

    it seems ok,  the parameter will change depends on the change event of ddl.

    Check the following:

    Best regards

    Cathy

    Wednesday, January 24, 2018 8:15 AM
  • User-1056786209 posted

    Hi Cathy,

    Thank you for your reply. this is not that the web pages are not working properly, but that I want to be able to load a url into my program to view the schedule for an event.
    But the issue is that the URL for the schedule is the same for every event http://www.nes.com/Schedule.asp . so there is nothing in the URL which specifies the event ID.

    I am trying to determine if there is a way to load a url in my perl program to load a specific events schedule.. Does that make sense?

    I assume the event id is somewhere behind the scenes? but I need to load it into my program. (I am trying to write a program where I can check to see each day if the schedule has changed from the day before.

    thank you

    JOhn

    Wednesday, January 24, 2018 1:14 PM
  • User475983607 posted

    I am trying to determine if there is a way to load a url in my perl program to load a specific events schedule.. Does that make sense?

    I assume the event id is somewhere behind the scenes? but I need to load it into my program. (I am trying to write a program where I can check to see each day if the schedule has changed from the day before.

    It is not possible to use a URL as the page is designed to read POST parameters (HTTP message) not GET (URL) parameters.  This is a fundamental concept in web site design that you need to understand before moving forward.

    https://www.w3schools.com/tags/ref_httpmethods.asp

    Wednesday, January 24, 2018 2:11 PM