I was in a similar situation where I had hundreds of files that I needed massaged and when I asked a GenAI tool to do it, it was too big of a task and only processed the first handful of files before giving up. In the end, the solution I found was to ask it to write a script to perform the task which ended up working well as writing a script was a smaller task and then I could run the script which would find and process all of my files. You may have had success with the "write me a script" approach that you could then just execute and and pass your files and process larger input.
That’s a great approach. When I just looked under the hood from my session all ChatGPT was attempting to do was generate a python script using the panda library. This definitely would have worked.
I was in a similar situation where I had hundreds of files that I needed massaged and when I asked a GenAI tool to do it, it was too big of a task and only processed the first handful of files before giving up. In the end, the solution I found was to ask it to write a script to perform the task which ended up working well as writing a script was a smaller task and then I could run the script which would find and process all of my files. You may have had success with the "write me a script" approach that you could then just execute and and pass your files and process larger input.
That’s a great approach. When I just looked under the hood from my session all ChatGPT was attempting to do was generate a python script using the panda library. This definitely would have worked.