I have a series of events stored as JSON in text files. These events represents actions carried out by users on a website - page view, item click, auto-complete etc. What I would like to do is find common journeys through my website - like the "Behavior Flow" tab in google analytics:
I would like to know if there are any standard tools or algorithms or techniques that are useful in producing this functionality. I am currently using Apache Spark, so my preference is for solutions compatible with that.
I can easily build this myself, but my intention is to learn about common best-practices (if any).
I use Python and BeautifulSoup. Is there a way I could tell if a particular website is running Magento platform?
Magento eCommerce Platform
How to Find CMS, Platform or Technology used by a Website?
Chrome Extensions to find CMS/Platform of a Website
Firefox Addons to find CMS/Platform of a Website
CMS Detector
Online Webtools has got a very nice CMS detector application which can be used just to find out the Content Management System used by a website or Framework used by a site.
Builtwith (Most Popular and Effective)
Builtwith is a very powerful tool to determine a site framework. Builtwith goes deep and throws you the more in-depth detail of a website including Server information, Content Management System, Framework, Advertising used, Analytics and tracking, Javascript libraries, Audio/Video media, Widgets used, Content Delivery Network, Aggregation Functionality, Document Information and Encoding type.
W3Techs (Popular and Highly Effective)
W3Techs gives the complete detail of a website. The details include Website background, Content Management System, Server side programming languages, Client side programming languages, Javascript library, Mark-up language, Character Encoding, Image file formats, Site elements, SSL Certificate authorities, Social Widgets, Web server, Traffic Analysis tools, Advertising network, Domain, Language and Technology Score. The tool gives ultimate in-depth data of a website which is extremely useful for a programmer. This tools is also available as Browser Extensions for Chrome and Firefox.
Guess Scritch
This tool analyzes websites and attempts to detect the plaform, language, tools, widgets, trackers and javascript/css frameworks and other technologies used for any website. This is a great tool to determine the CMS of a website.
Guess Scritch
WhatCMS WhaCMS just displays the Content Management System used in a website and doesn’t analyze any other information. If you only need to lookup a website platform in which it is built, then this toll is of great help.
CMSEYE
This tool seems to be down/unavailable
W3Techs
This extension is probably the best one to analyze various aspects of a website. W3Techs gives the complete detail of a website. The details include Website background, Content Management System, Server side programming languages, Client side programming languages, Javascript library, Mark-up language, Character Encoding, Image file formats, Site elements, SSL Certificate authorities, Social Widgets, Web server, Traffic Analysis tools, Advertising network, Domain, Language and Technology Score. The tool gives ultimate in-depth data of a website which is extremely useful for a programmer.
This tool just shows up the CMS of a website.
Chrome Sniffer
This extension will help web developer to inspect web framework / CMS and javascript library running on current browsing website. An icon will appear on address bar indicates the detected framework. Currently, this extension can detect more than 100 popular CMS and javascript libraries.
Wappalyzer
Wappalyzer uncovers the technologies used on websites. It detects content management systems, web shops, web servers, JavaScript frameworks, analytics tools and many more.
check this link.. will help you
There are many ways to find whether a site is running on Magento or not.
Check page source of any page, if it has like skin/frontend
In address bar, open url /downloader, if it opens magento connect login page
In address bar, open url /install.php, if site is Magento site, then it will show following error:
FAILED ERROR: Magento is already installed
Another clue can be admin url. Most of Magento stores don't bother to change admin url. If it opens by hitting /index.php/admin and shows Magento somewhere on page, then it is 100% running on Magento Platform.
I hope, this will help you.
When I used the Google structured data markup helper it offered me the category software which seems quite to fit to my website project which offers fan mission downloads for games.
But this category is refering to SoftwareApplication from schema.org. And a fan mission isn't an application. What is your advice I should use?
SoftwareApplication would offer downloadUrl, fileSize, fileFormat, screenshot & softwareVersion which I currently use.
When I use CreativeWork (Which could be anything!) instead I would lost those.
I think you can use CreativeWork and still give it attributes from Software. Once you do that, e.g. to a test page, you can use Structured Data Testing Tool to see how Google recognized your markup:
http://www.google.com/webmasters/tools/richsnippets
Your use case is described in schema.org docs here:
http://schema.org/docs/faq.html#12
I have an image and I want to search to see what it is. Any API's available for that?
I believe there are quite a few. You want to search for Content-based Image Retrieval (CBIR). Wikipedia has a page of CBIR engines, including an extensive list of open source ones. For example, isk-daemon and LIRE are both open source CBIR libraries:
isk-daemon is an open source standalone server and library capable of
adding content-based (visual) image searching to any image related
website or software.
The LIRE (Lucene Image REtrieval) library provides a simple way to
retrieve images and photos based on their color and texture
characteristics.
Another one is fire it's GPL and they use the Magick++ libraries.
Just wondering what software you use to create a visual sitemap / site structure representation before you start big sites?
I am looking to map out a large site, but cannot find any good software to help me map the site visually (And in pages/categories)..
Maybe SketchFlow http://electricbeach.org/?p=145 ? which is included in the Expression Blend Trial http://www.microsoft.com/downloads/details.aspx?FamilyID=92E1DB7A-5D36-449B-8C6B-D25F078F3609&displaylang=en
I strongly suggest taking a look at this tool: http://www.balsamiq.com/products/mockups
The Balsamiq tool is the best for doing mockups (i assume this is what you are referring too when talking about sitemaps before you start...). With this software you can quickly generate a working wireframe of what ever you are creating. So much functionality that you can actually share it with your client to get some good sign offs prior to typing the first bit of code.
Very powerful!
And the other one...just shown at the last MIX09 is SketchFlow. Couldn't remember it to save my life. This is a WAY COOL tool for site maps and UI mock up. I was trying to find you the actual MIX presentation as it is super cool to watch. But here are some YouTube videos of that presentation from a user perspective I guess.
http://www.youtube.com/watch?v=zsAZjb7FKXA
http://www.youtube.com/watch?v=f3ErrS68YMM
Check it out!
update...found the SketchFlow video!!! http://videos.visitmix.com/MIX09/C01F
Great keynote from there too: http://videos.visitmix.com/MIX09/KEY01
I know this is an old question, but for others who find this via search, I personally love mocking my websites up with mind mapping tools. I've tried several but my favorite was MindNode for Mac and Xmind for Windows.
XMind free download:
http://www.xmind.net/
MindNode free download:
https://mindnode.com/
I've also tried MindMeister which works just as well as other mind mapping tools and is hosted for you so you can access your mind maps anywhere. However, MindMeister only allows you three maps (currently) without upgrading to a paid subscription.
Another that I've worked with is mockflow.com which is great for mocking up websites with all their features and buttons and even making clickable navigation. They have a free version, but again it's very limited without upgrading to a paid version.
I'm using Slickplan. This cloud based app allows me to have access to my projects from different machines regardless of their operating systems. All I need is one of the leading web browsers (Chrome, Firefox, Safari).
With Slickplan you can create visual sitemaps from scratch or you can use Site Crawler to import your existing website to visualize and reorganize its structure.
Of course you can always export your projects to the XML format, and use the exported file to create pages and menu systems inside some popular content management system - Slickplan provides plugins for WordPress, Joomla, concrete5 and a few more.