I'm currently working on a news website project. It has a lot of categories, subcategories and links. When creating the sitemaps for this project, I planned to create an Index sitemap that lead to the categories sitemaps. To avoid the 50000 urls marks, I intend to create sitemaps weekly. This will result in 52 sitemaps per year per category.
What I want to know is, if I have (for example) 10 categories I'll create 520 sitemaps over a year. Is this number a lot ? Should I approach this problem in any other way ?
There is no limit on number of sitemaps. As long as each isn't more than 10MB and 50,000 URLS. Address to each sitemap must be in one and only one sitemap index file.
This site has more information (http://www.sitemaps.org/protocol.html#index)
Related
.CSV Product List
I have a .CSV file with a list of product. And I need to make a RPA bot to Data scrape the list of products from online shopping websites. The data scraped from online shooping sites must be stored into the same DataTable. The bot must also be able to extract the product name from .CSV file and search the product's name on shopping site by itself, no matter how many items I add-on or reduce from the .CSV file in the future. I had added the picture of my .CSV product list, please ignore the Budget column. I understand how to data scrape, but I am not sure of how to design a RPA bot with such feature I mentioned above. Please help me T^T...
I have created a new category on my store after creating this website taking 15-20 seconds to load, but before that it's taking only 5-6 seconds
Please re-index all the index and if it is still slow you can try by using flat tables for catalog.
Also make sure you have not added anything wrong in category details like special characters in desc etc.
I've been dealing with this problem with around 10k+ products in two store views in magento 1.7.
The URL indexing process took around 30 hours to change its state to ready. Also i found multiple entries of the same product being made in the core_url_rewrite table and the number of rows now reached upto 6500k.
This is causing deadlocks. I tried clearing the locks but that didn't help. Is there a workaround solution for this problem as this is magento core functionality?
There's some good general advice on the Magento Stack Exchange site covering common indexing problems.
It's also common for larger store to create a rewrite/code-pool-override for the following method
#File: app/code/core/Mage/Catalog/Model/Resource/Url.php
protected function _getProducts($productIds, $storeId, $entityId, &$lastEntityId)
{
//...
}
This method queries for the products that need a URL reindex. By default, this includes all simple and configurable products. However, if you're not displaying simple products individually, you can tweak this query to not include those products. That can greatly reduce the number of URLs Magento needs to generate.
I am using Magento 1.7.0.2, with approximately 4,000 product items and 3000 customer accounts, recently I have been tasks with uploading a large amount of customer prices. The prices will be held against the product as group prices, and the customers price will be determined by the group they belong to - all standard magento and all working fine.
However the requirement will mean i will be required to upload 650 customer groups, and then associate a product price with each group
This yeilds 650 * 4000 = 2,600,000 - A lot of prices!
I'm aware that this will take some time to complete as a process the question is can Magento handle this number of prices?
thanks
Magento is able to handle this. Of course it depends on the hardware also :).
There might be some problems in the add-to-cart and checkout process. by problems I mean it might slow down the process a little.
For product listing Magento uses the index tables for prices (and others) so this shouldn't be an issue.
By the way...your indexing process will take longer. You might not be able to run it from the backend (but that is not recommended anyway).
I've got an online shop with more than 70.000 products. In a few months we will have more than 200.000 products.
Every product has its own url depending on the language, for example:
domain.com/es/aaabbbcccc/product_code
domain.com/en/aaabbbcccc/product_code
domain.com/fr/aaabbbcccc/product_code
domain.com/pt/aaabbbcccc/product_code
domain.com/de/aaabbbcccc/product_code
All those url redirect to the same page but the language depends on the "es", "en", etc.
We want Google to index the sitemap so it knows all of our products so they can be found using Google Search.
I've been reading about sitemaps and if I'm not wrong, they should contain all available url in a webpage, but I know we cannot put 5 url for every product because that would get one millions urls.
Should I define just one url for every product, which would generate thousands of urls? Or is there any way to tell Google the format of a url so it is not necessary to explicitly define all of them?