As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 11 years ago.
I have a sprider collect data from some web site.but it offen be denied.
I think it basis of my IP address.
how can I fake my IP address. or have a another way to avoid be denied.
thx.
Well what you can do is try to access the end point through a proxy server. If the end point is tougher and can detect if you're coming through a proxy, you can try proxy chaining, or better still try something like tor. Look at this question - Connect to Tor network with ruby for further help.
The only way would be to use a proxy, or to ask your ISP/hosting provider to give you a new one (and I suspect they probably won't, or if they do, they won't do it too often.)
If a site is blocking your IP address because you're running a spider on it, you should maybe think about how often you go to that website and how much traffic you cause the site. There's a reason they're blocking your IP (if they are.) Maybe change how often you go to the side with the spider, and also determine whether or not you should be (though I don't have any details on the site, so I can't comment on that)
Related
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 10 years ago.
I wrote my first web app using Sinatra. It's pretty simple with a REST interface. I am running MySQL database and it connects to it using active record, very cool stuff. Also, I am running another ruby program which basically queries the MySQL database every 30 seconds and does some work on the data and updates the db.
Right now, I am running sinatra app on my laptop. I want to move this to a server because i can't keep my laptop on all the time.
I checked out Amazon EC2 and there's so many options that I am over whelmed. Is Amazon EC2 even a good choice? Is so, what option is best for me? I am not expecting any bandwidth.
Any pointers for someone starting with webservers/hosting would be great, Thanks!
Well there's a free micro instance for new customers so that seems like the logical place to start. If it's not enough you can consider upgrading, look at the reserved/on demand pricing and make an informed decision at that point.
Have you looked at hosting with companies such as Heroku and AppFog?
They both offer free plans so you can give them a go before upgrading, or you may find the free plan is enough.
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 10 years ago.
I setup an AppHarbor application only to find out that it does not support embedded RavenDB. It looks like it may be coming soon to AppHarbor. In the mean time, all it does is throw an error as shown here.
Does anyone have any recommendations for shared hosting providers that support RavenDB? I am working on a small project, so free would be awesome (which is why I looked towards AppHarbor).
AppHarbor now has a great RavenDB add-on from the guys at RavenHQ.
I have already reported and discussed the issue on the RavenDB mailing list (hint).
http://groups.google.com/group/ravendb/browse_thread/thread/af98f98a35289ad1/f9e040d8acfd0c72
You do understand that every deploy (and even possibly between deploys) that your data will be wiped/reverted to the source control version?
If that is fine and the data set is small, run RavenDB in-memory mode and seed the data to it.
Else as you mention RavenNest (hosted RavenDB for AppHarbor) is coming soon, Ayende and team are testing it internally I last heard.
You can try www.winhost.com as described here:
How can I run RavenDB in a shared hosting environment?
It has the so desired Full Trust Allowed which is something one should look for in the case of RavenDB to avoid the current security permissions problems...
NOTE: I just tried this host and can confirm that it works great with RavenDB in Full Trust... :-)
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 11 years ago.
Each time, when we type the key-words in Google, how does Google give us its answers?
I want to know the process of how Google process our requests.
Personally, I assume that:
1.there are a huge amount of queries sent to Google, in order to respond ASAP, Google gotta have some kinda distributed system, right?
2.also, I think there are some kind of cache systems to speed up Google's response speed, right?
3.If cache indeed exists, what is stored in that cache? Could it be some kind of <key, value> pair? Cuz I guess that, it's <key-words, url>. But would be it be too expensive to cache url directly, because each url will probably take up many memory, right?
UPDATE:
After skimming the keynote suggested by #Gregory Pakosz, I wondering what the Cache Server is responsible for and what the Cache Server caches?
Jeff Dean's 2009 keynote: Challenges in Building Large-Scale Information Retrieval Systems gives a pretty nice overview of how Google works.
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 10 years ago.
anyone know of a decent site where i can lookup where an ip address is?
e.g. if i have ip address x.x.x.x.x and i want to know if that ip is in london or scotland.
i've been going around google and what the sites i have found are saying is that ip x is located in location london when it shud be roughly 250 miles away from there.
thanks
p.s. must be free
you can use http://whois.domaintools.com/ for example http://whois.domaintools.com/stackoverflow.com and for ip information for example http://whois.domaintools.com/69.59.196.211
hostip.info is a free (community-based) solution that works well and has reasonable accuracy. It also has an API for easy integration, or you can download their complete database if you need quick or heavy access.
Maxmind is an IP location database that will allow you to lookup IP address locations. Maxmind technology is behind quite a lot of IP tracing software and websites, including Visual IP Trace.
Dan
http://www.visualiptrace.com
I use this one all the time. It allows 20 lookups per day. http://www.ip2location.com/
As far as I can tell, it usually gets it right, though there are uncertainties for many IP addresses due to the way ISPs manage them.
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 9 years ago.
The company I work for currently uses "Go To Meeting" to share our desktops but it's quite expensive for what we use it for and we are looking for cheaper (or even free) alternatives.
We have evaluated yuuguu and yugma but they aren't up to scratch. They are both slow and only allow the sharers to share the entire desktop as opposed to individual applications.
The functionality we need is to specify which application is shared and also to give the viewers permission to control the mouse and keyboard. Everything else would be an added bonus.
Thanks.
I use CrossLoop and it works well, it is free!
I use LogmeIn and Hamachi, for remote desktop and VPN solutions. They have free and paid plans.
thanks for the help. None of the options provided were what we were looking for. We are going to try Microsoft SharedView, seems to have the functionality we require:
http://www.microsoft.com/downloadS/details.aspx?familyid=95AF94BA-755E-4039-9038-63005EE9D33A&displaylang=en
Remobo works quite well too
All network traffic in Remobo are end-to-end encrypted with 256-bit AES algorithm, and only the chart participants have the keys to decrypt the message. Plus, Remobo's file transfer is fast & safe, because all computers in a Remobo User's Instant Private Network (IPN) have direct network connections to each other; messages are relayed via Servers from Remobo.com only if direct connection cannot be established.
It NOT require any configuration on any of your existing networking devices, and you do not need to add any new hardware devices into your network to run Remobo