I need help in integration of the scripts and the modules to work perfectly.
Please help me also in correcting the issues within the script.
Also, I need help with the following conditions:
1. Put the text pattern as variable instead of a literal
0000000000_* in [login to view URL]
2. Arguments should be clearly define with regard to $2 & $3
Clearly define all the arguments in [login to view URL] with regard to $2, $3
3. Remove all of the 'remain_entries' logic, from the while to done.
Remove the below code from [login to view URL] and make it straightforward to read the files from the directory one by one, once they are processed move the file to the archive folder.
while IFS= read -r entry; do
while IFS= read -r line; do
if [ "$entry" == "$line" ]; then
4. Mail logic to be completed. Code for mail in [login to view URL]
5. Avro tools command -
Remove/comment out the code from [login to view URL] as we are not using the converted Json further
6. Demonstrate the running of code as part of dry run and replace the processing script with a stub (for pyspark program) with the stub sleeping for 1 min and returning zero
7. Archive folder to be specific.
Little changes are to be done, so, please do it at the earliest.
Mirza Mujtaba Baig