Troubleshooting Magmi by way of the least-common-denominator, I exported a framework CSV from one Magento site with Dataflow, then immediately re-imported it with Magmi on another Magento site. I got an error:
CSV Datasource v1.2 - warning: line 1 , wrong column number : 25 found over 1, line skipped
I'm guessing there is something in the site's Magmi setup that I can't quite see, that is controlling any other imports? This second site already uses Magmi to import products on a nightly basis. I see the error above using both its established profile, and any other profile I create.
Magmi, by default, is set to process CSV files with each column enclosed in a double quote ".
If you look under the Configure Current Profile section, you'll find a filed labeled CSV Enclosure, with a double quote populated.
On the other hand, Magento exports the CSV files without the double quote wrappers. Try removing the double quote from the CSV Enclosure field in Magmi, then saving the profile. Do a test run and see if that works.
If this doesn't work, you can import the file into Excel and resave the file using double quotes. The method that works for me goes as follows:
Open Excel (create a blank spreadsheet)
Go to the Data tab in Excel, click the From Text button.
Open your CSV exported from Magento
Choose Delimited and click Next
Under Delimiters, select Comma. Click Next
On the Data Preview section, highlight all of the columns (Hold shift and select the farthest column on the right).
Choose Text under Column data format
Click Finish
After you verified all of your data is correct in the spreadsheet, you'll have to export it to wrap all of the cell values in double-quotes. To do this, follow this tutorial:
http://www.markinns.com/articles/full/export_excel_csvs_with_double_quotes
After the file is saved, upload it to your var/import directory, set Magmi to use " as the CSV Enclosure, and try running the import.
Related
I am using admin csv import feature
In my csv file I have base, small and thumbnail image columns
When I do an import, all image come in fine and can be seen as expected
However, when I do a subsequent import, if the image columns are in that csv doc then I am seeing multiple images in the PDP page
Is there a way to prevent this other than not having the columns in the import file, obviously
No, this is not possible. For that you need to do custom code.
I usually deal with large standardize delimiters similar to a “xxxx”,”xxxxx” (comma separated with quotes). Instead of those characters we use the following
Text Character ASCII Character
———————————————
Comma ————-> 20
Quote ————-> 254
NewLine ————-> 174
Multi Value ————-> 059
Nested Value ————-> 082
Currently i use a macro with RegEx to converted to Tab Format by replacing \x{00FE}\x{14}\x{00FE} with \t Is there a method of creating a TSV definition in EE? so i can quickly switch from format to format?
I have attempted without success, changing the delimeter in the Tools → Customise → CSV section, but there is method of replacing quote character
I tried replacing the delimiter in two was \x{14} and \x{00FE}\x{14}\x{00FE}
http://nextcloud.eclipsephoto.net/nextcloud/index.php/s/5b8pen55LW43cPr
I have already tried but did not seem to work,
thank you in advance.
Please enter \xfe\x14\xfe in the Delimiter text box in the CSV page of the Customize dialog box.
Alternatively, you can replace \xfe with a double quote, and \x14 with a tab after you open your file. I wrote a macro for you:
batch_list = editor.filters;
batch_list.AddReplace("\\xfe","\\x22",eeFindReplaceCase | eeFindReplaceEscSeq,0); // replace \xfe with a double quote
batch_list.AddReplace("\\x14","\\t",eeFindReplaceCase | eeFindReplaceEscSeq,0); // replace \x14 with a tab
document.selection.BatchReplace(batch_list,eeReplaceAll,0); // batch replace
editor.ExecuteCommandByID(22529); // TSV mode
editor.ExecuteCommandByID(3894); // heading 1
You can run this macro after you open your data file. To do this, save this code as, for instance, OpenDataFile.jsee, and then select this file from Select... in the Macros menu. Finally, open your data file, and select Run in the Macros menu while your data file is active.
Updates
EmEditor v20.0.901 now allows any arbitrary character to be used as a quotation mark for a CSV format. Please update EmEditor to v20.0.901 (or above), select Customize on the Tools menu, select the CSV page, and click the Reset button to add the Concordance load file (DAT) format to the CSV format list, or you can manually add a new format to your existing list with the delimiter of \x14 and the quotation mark of \xfe.
After you open a DAT file, you can click the "DAT" button in the CSV/Sort toolbar. To select the DAT format automatically when a file is opened, select Properties for Current Configuration on the Tools menu, select the File page, and set the Concordance Load File (DAT) (or your new CSV Format) check box in the CSV files to Detect list box.
If you want to remove quotation marks (or thorns) after you open a DAT file, you can click the CSV Converter button in the CSV/Sort toolbar, and click Remove Unnecessary Quotes button.
I am building a proof of concept using Elasticsearch Logstash and Kibana for one of my projects. I have the dashboard with the graphs working without any issue. One of the requirements for my project is the ability to download the file(csv/excel).
In kibana the only option i saw for downloading the file is by clicking on edit button on the visualization created. Is it possible to add a link on the dashboard that would allow users to download the file without going into the edit mode. And secondly I would like to disable/hide the edit mode for anyone other than me who views the dashboard.
Thanks
To export data to csv/excel from Kibana follow the following steps:-
Click on Visualize Tab & select a visualization (if created). If not created create a visualziation.
Click on caret symbol (^) which is present at the bottom of the visualization.
Then you will get an option of Export:Raw Formatted as the bottom of the page.
Please find below attached image showing Export option after clicking on caret symbol.
FYI : How to download data in CSV from Kibana:
In Kibana-->
1. Go to 'Discover' in left side
Select Index Field (based on your dashboard data)
(*** In case if you are not sure which index to select-->go to management tab-->Saved Objects-->Dashboard-->select dashboard name-->scroll down to JSON-->you will see the Index name )
left side you see all the variables available in the data-->click over the variable name that you want to have in csv-->click add-->this variable will be added on the right side of the columns avaliable
Top right section of the kibana-->there is the time filter-->click
-->select the duration for which you want the csv
Top upper right -->Reporting-->save this time/variable selection with a new report-->click generate CSV
Go to 'Management' in left side--> 'Reporting'-->download your csv
In Kibana 6.5, you can generate CSV under the Share Tab -> CSV Reports.
The request will be queued. Once the CSV is generated, it will be available for download under Management -> Reporting
I totally missed the export button at the bottom of each visualization.
As for read only access...Shield from Elasticsearch might be worth exploring.
I can use csv files to enter data into input field after a test is recorded. I was wondering if csv file could be used for "Find Text" validation field. I don't see options to add csv file so I have directly hardcode text be checked. If I could add a csv file then I would just need to change the csv file once the website texts are changed. Could this be done by using codedUI test?
Thank you
The fields of a data source can be used in many places within a Web Performance Test. There are two main ways.
In the properties panel for the call of the validation rule, click in the value field for the required property. You should get a box allowing the data source field to be chosen.
Alternatively enter text similar to the following into the field
{{DataSource1.YourFileName#csv.FieldName}}
Note the doubled curly braces {{ and }} around the full data source string. You can also add extra text to this sort of entry, eg
Some text{{DataSource1.YourFileName#csv.FieldName}}and even more text
I am trying to add products by duplicating them in a CSV file. It seems to work fine but when I update the product image path with the same path to multiple products it doesn't seem to update. When I export again and look at the data it has reverted to it original state. What is the problem here...?
Please review the following: http://www.magentocommerce.com/knowledge-base/entry/importing-product-images
Typical Problems:
Path
Name of File (Name does not match file name. ie: Name.jpg vs /name.jpg)
Image file does not exist on server for processing. (file is not at store/media/upload/file.jpg)
Permissions (store/media/* store/media/upload not accessible)
Reminder: When dealing with Image Modification/Upload etc, please flush (disable during trouble shooting) the cache, then re-enable after.
Uploading via Dataflow:
Assuming you have the correct basic required fields, there are two main behaviors.
If the SKU is unique, the product ID will be created in the system.
If the SKU exists, information will be replaced/updated or Appended in the system.
When you copy and paste, you will want to make sure each SKU is unique, and that there will be a correlating image that will 'live' on the server during the upload dataflow process.
In the case of Images, the Path is going to be looking for yourstoreroot/media/import/ for the images you reference in your image / small / thumbnail, if the image doesn't exist with the path described, or doesn't match exactly the name, then the data will not be added/appended in the cart as it is invalid to the import files and would not show on new exports.
To solve this problem I learned how to create an attribute, an attribute set, then a configurable product. With the configurable product I can apply the image once. Each product listing with a different size or color is listed as an associated product with all duplicate content but is not visible individually.
Here is a tutorial that got me started:
http://www.magentocommerce.com/knowledge-base/entry/tutorial-creating-a-configurable-product
Found this question via Google looking for something similar and thought I'd chime in.
The most common problem I've encountered (and its poorly documented) is that when importing using the built-in import tool, the "image" path must be relative to /media/import/. Note that by default there is no 'import' folder in /media, you'll need to make it.
That means that in your CSV under the "images" column, you should have '/somepicture.jpg', this corresponds to /media/import/somepicture.jpg during the actual import. If this is incorrect, while the import is going on you'll see a bunch of "image not found" errors scroll by, and the existing image data will not be updated.
Unfortunately it does not look like there is a way to simply update the stored image path (such as pointing a bunch of products to the same image) using the built-in importer, as it expects to be importing new images, and will dupe them up just like editing images manually does.