how to read all file contents in a directory with Laravel - laravel

Question

I have so many files in a directory and I want to read all of them and save them in Database.
I know how to do it but the way i know is that all file contents will load to the memory at the same time and web application will be dead. I tend to put some limits like it reads 300 files at the same time and after that it goes through the next 300 files.
as you can see I have 736 files here.
this is my sample file contents :
I'm using this code to split them.
foreach ($contents as $content) {
$slice = preg_split("/\\r\\n|\\r|\\n/", $content);
}
and results :

Answer 1

You can use laravel's filesytem and the Storage facade to achieve this:
$files = Storage::disk('public')->files('path/to/files');
foreach ($files as $file) {
$contents = Storage::disk('public')->get($file);
// Save contents to DB;
}
You could also do them in batches by building up an array of contents
$files = Storage::disk('public')->files('path/to/files');
$contents = [];
$toMove = [];
foreach ($files as $file) {
$content = Storage::disk('public')->get($file);
$slice = preg_split("/\\r\\n|\\r|\\n/", $content);
$contents[] = [
'metadata' => $slice[0],
'data1' => $slice[1],
'data2' => $slice[2],
'data3' => $slice[3],
];
$toMove[] = $file;
if (count($contents) === 10) {
DB::table('informations')->insert($contents);
foreach($toMove as $file) {
Storage::disk('public')
->move($file , 'done/'.Str::of($file)->after('/'));
}
$contents = [];
$toMove = [];
}
}
if (count($contents)) {
DB::table('informations')->insert($contents);
foreach($toMove as $file) {
Storage::disk('public')
->move($file , 'done/'.Str::of($file)->after('/'));
}
}