I want to see each url request made my by browser.
I want to see the url requests made by ajax.
Which software should I use? Some java code would also help.
You can use Fiddler or if you need to "go deep" (as their web page says), you can use Wireshark.
Firefox has a great plugin called LiveHTTPHeaders that I think will get you what you are looking for. I'm not positive on the AJAX part of the question, but it's worth a shot. I consider LiveHTTPHeaders to be an indispensable tool for anyone doing web development.
Use Firebug
(source: getfirebug.com)
Otherwise use Wireshark http://www.wireshark.org/ if you want the swiss army knife of network capture tools.
There are lots of great programs out there that will do this. My answer would really depend on what you are trying to do.
Adding an HTTP proxy that logs requests will easily do the job.
You can also leverage browser plugins such as FireBug and Google's Page Speed to see the requests fly in realtime.
Jacob
I don't really understand where do you want to see the traffic. But if what you mean is browser and if you are using Firefox then Firebug will come handy.
So many great extensions for Firefox that'll give you that info:
Firebug
PageSpeed
LiveHTTPHeaders
You could also try using the developer tools in Safari or Chrome if you're not a Firefox fan.
If you use IE... why are you using IE? ;-)
Any personal proxy will do. Fiddler was already suggested.
For Firefox I would use the TamperData plugin.
Related
Fiddler lets me intercept http requests and respond with files from from my local machine. I am looking for a tool that does exactly that, on mac.
I tested charles but its "rewrite tool" does not allow that. I tried also httpscoop which allows only looking at requests, and wireshark where I could not even find the gui (probably due to my noobness on mac)
As far as I understand it, Charles' Map feature offers what you're looking for.
If you have a Windows PC or VM on your Mac, you can use Fiddler to capture the Mac's traffic. Also worth noting is that I'm at Telerik now and one of our goals is to support more platforms with Fiddler. An alpha version of Fiddler for the Mono framework is now available.
you can try a free chrome extension: Trumpet
Features:
Wildcard pattern
RegEx pattern
Category
File drag
Try Tamper, it's based on mitmproxy and it allows you to see all requests made by the current tab, modify them and serve the modified version next time you refresh.
I remember a plugin that could detect which OS and what programming language was used on the server side. I don't know anymore what the name was. It could be Firebug or something like that, but I can't find the function.
Firebug makes it easy to look at the headers send by the Server. But be aware, that server could fake or hide this parts of header, so it does not work always.
This is a Browser Plugin called wappalyzer http://www.wappalyzer.com. if you are using firefox plugins site just search for wappalyzer.
The latest versions of Firebug in Firefox feel like they've been regressing. Performance is abysmal. This is a common complaint amongs everyone on my team, and increasingly among many other web developers online.
Are there any alternative extensions for Firefox that gives similar functionality(DOM inspector, Net tab, console)?
Firefox now has built in developer tools similar to Firebug, but not so full-featured:
https://www.mozilla.org/en-US/firefox/technology/
http://www.webmonkey.com/2011/12/an-overview-of-firefoxs-coming-developer-tools/
Fidler Web Debugger is an option, although it's not as integrated.
Other alternatives include:
Jash: Javascript Shell
Internet Explorer Developer Tools
FireAtlas (extension to FireBug, but helps debug ASP.NET)
The IE8 Debugger is pretty good, for IE. They seemingly took several cues from Firebug.
I agree with you as far as Firebug's performance goes in recent releases, therefore I have found myself using the excellent WebKit Inspector - in both Chrome and Safari - and Opera Dragonfly a lot more recently.
If you were to post your specific problems about Firebug performance to the Firebug newsgroup or bug list, then we'd just fix them. No one has ever complained about performance. We had some problems with memory but these were fixed.
jjb
For Http/Https traffic inspection HttpFox is very great tool. u'll get an add-on for firefox in the web. However it doesn't have the cool dom inspection feature of firebug.
Check out
Dung Beetle
Also, exclusively for XPath expressions, but pretty fast,
XPath Checker
What is the best solution to programmatically take a snapshot of a webpage?
The situation is this: I would like to crawl a bunch of webpages and take thumbnail snapshots of them periodically, say once every few months, without having to manually go to each one. I would also like to be able to take jpg/png snapshots of websites that might be completely Flash/Flex, so I'd have to wait until it loaded to take the snapshot somehow.
It would be nice if there was no limit to the number of thumbnails I could generate (within reason, say 1000 per day).
Any ideas how to do this in Ruby? Seems pretty tough.
Browsers to do this in: Safari or Firefox, preferably Safari.
Thanks so much.
This really depends on your operating system. What you need is a way to hook into a web browser and save that to an image.
If you are on a Mac - I would imagine your best bet would be to use MacRuby (or RubyCocoa - although I believe this is going to be deprecated in the near future) and then to use the WebKit framework to load the page and render it as an image.
This is definitely possible, for inspiration you may wish to look at the Paparazzi! and webkit2png projects.
Another option, which isn't dependent on the OS, might be to use the BrowserShots API.
There is no built in library in Ruby for rendering a web page.
Using Selenium & Ruby is one possibility. You can run Firefox as a headless browser (ie on a server).
Here is the source code for browser shots. http://sourceforge.net/projects/browsershots/files/
If you are using Linux you could use http://khtml2png.sourceforge.net/ and script it via Ruby.
Some paid services to try and automate
http://webthumb.bluga.net/home
http://www.thumbalizr.com
as viewed by.... ie? firefox? opera? one of the myriad webkit engines?
if only it were possible to automate http://browsershots.org :)
Use selenium-rc, it comes with snapshot capabilities.
With jruby you can use SWT's browser library.
I always have to check each and every browser to see if my website would work. Is there a website where I can check it with?
Update:
I don't really want just screenshots (which what browsershots do), I want to actually test the posting of my script.
You want a web site to check your web site for javascript compatibility? How would you expect it to know how to exercise your interface to trigger the proper interactions? Or are you thinking of it doing some sort of static code analysis? I think you are better off coding against a framework that has solved most of the browser-dependent idiosyncrasies and using it to check for browser capabilities before you use them. jQuery, MooTools, Prototype/Scriptaculous, etc. go a long way in solving these problems for javascript.
Note that you still need to worry about rendering your site, but you already have several answers for how to go about doing that based on web sites. Personally, I just maintain IE/Safari/FF/Opera/Chrome on my workstation and do significant checking in IE/FF and basic checking in Safari/Opera/Chrome.
Even when there exist websites that allow you to see a static snapshot of your site in several browsers, you should really test your page on them yourself, because there can be subtle, and not so subtle, bugs and differences that are only apparent when interacting with the webpage.
You can cover yourself quite a lot by testing in
A Gecko engine browser (Firefox)
A Webkit engine browser (Chrome, Safari, Konqueror)
Opera
AND IE6+
John Resig recommends checking the Yahoo graded browser support documentation.
If you write unit tests for your javascript, you could use testswarm http://testswarm.com
There are multiple options:
http://ipinfo.info/netrenderer/
These site will let you run multiple browsers and version without installing. You only need to install a plugin
http://spoon.net/browsers/
There are plenty of sites, just Google/Bing for browser compatibility check.
http://browsershots.org/ is a good one.
Although most of them just take a snapshot of the site, you might have to do the manual check for things like menus and dynamic content.
BrowserShots might do what you want if you can tell by rendering a particular URL whether or not things will work as expected.
In light of your update, you could still use BrowserShots by creating a page which tests each of your scripts and renders 'pass' or 'fail' as its content depending on whether they work or not.
Failing that, Multiple IE is quite useful for running various versions of IE on one PC which can otherwise be problematic.