Value Investing Forum

Discuss value investing stock ideas

You must be logged in to post
Search Forums:


 






Wildcard Usage:
*    matches any number of characters
%    matches exactly one character

Too many web page retrievals?

No Tags
UserPost

5:18 pm
January 5, 2012


jalleninvest

Coronado, CA

Member

posts 22

4

rharmelink said:

When most of the add-in functions are invoked, they actually extract data from a copy of the web page that was saved by the add-in.  This is done to make the functions run more quickly, because the actual retrieval of a web page from the Internet is the part of the process that takes the most time.  For example, if you were to get 20 or 30 data items from the same web page, this process allows the web page to be retrieved once and then all extractions are done from that single retrieval of the web page from the Internet.  Otherwise, each invocation of those functions would need to grab a new web page.

In general, the process operates as follows:

  • The "saved array" is first checked, to see if the web page the data is being extracted from has already been retrieved from the Internet.
  • If an entry in the "saved array" is found, the data is extracted from the saved copy of the web page.
  • If an entry is not found in the "saved array", the source code of the web page is retrieved from the Internet and then put into the "saved array", which is indexed by URL.  Then, the data is extracted from that saved copy of the web page.

However, that "saved array" is sized at 1000 web pages.


 

I'm glad I'm an investment guy and not a computer genius, or maybe if I was, reading your post wouldn't make my head hurt!Wink

I have no idea how this works, and it appears I am destined to have it remain that way.

 

Thanks, though.

7:47 pm
January 4, 2012


rharmelink

Member

posts 8

3

Post edited 11:48 am – January 4, 2012 by rharmelink


When most of the add-in functions are invoked, they actually extract data from a copy of the web page that was saved by the add-in.  This is done to make the functions run more quickly, because the actual retrieval of a web page from the Internet is the part of the process that takes the most time.  For example, if you were to get 20 or 30 data items from the same web page, this process allows the web page to be retrieved once and then all extractions are done from that single retrieval of the web page from the Internet.  Otherwise, each invocation of those functions would need to grab a new web page.

In general, the process operates as follows:

  • The "saved array" is first checked, to see if the web page the data is being extracted from has already been retrieved from the Internet.
  • If an entry in the "saved array" is found, the data is extracted from the saved copy of the web page.
  • If an entry is not found in the "saved array", the source code of the web page is retrieved from the Internet and then put into the "saved array", which is indexed by URL.  Then, the data is extracted from that saved copy of the web page.

However, that "saved array" is sized at 1000 web pages.

4:11 pm
January 4, 2012


Jae Jun

Admin

posts 1453

2

yes excel sets it. Save the file you're working on. Close excel completely and reopen.

4:01 pm
January 4, 2012


jalleninvest

Coronado, CA

Member

posts 22

1

Post edited 8:01 am – January 4, 2012 by jalleninvest


I was sitting here running analysis on the stocks that show up on one of my screens.  At no. 48, I start getting "Error – too many webpage retrievals."

 

What is this?  Is there a limit?  Who sets it?  Where does the data come from?

No Tags


About the Stock Valuation Software forum

Forum Timezone: America/Los_Angeles

Most Users Ever Online: 170

Currently Online:
17 Guests

Currently Browsing this Topic:
1 Guest

Forum Stats:

Groups: 4
Forums: 40
Topics: 763
Posts: 4096

Membership:

There are 956 Members
There have been 9 Guests

There is 1 Admin
There are 3 Moderators

Top Posters:

somrh – 336
Graeme – 180
nell – 100
zehua – 96
valueinvestortoday – 80
krackerjack121 – 69

Recent New Members: jman, matias091, foundos, pberardi, JohnnyB, Style

Administrators: Jae Jun (1453 Posts)

Moderators: Jae Jun (1453 Posts), VANYA (1 Post), djsun (0 Posts)