I’m following one of the sessions for the hackathon and trying to use the mongoimport.sh script that is in available via gdeltools to put the data in my cluster , but nothing is happening after I run the command in my terminal, and my database is still empty meaning no data was imported into it.
I’m using a Windows PC and running the command in Powershell (in Visual Studio Code).
Here’s the command I’m running: ./mongoimport.sh --uri "MY CONNECTION STRING"
Hey @Fiewor_John - sorry to hear you’ve been having trouble with this. The mongoimport.sh script is written to run on Linux - so you could run it in WSL on Windows, if you have that set up. Otherwise I can look at translating it to Powershell - I’ll have a look at this today, as I’m sure you’re not the only one who needs this.
It’s also worth noting that you need to have the .CSV files in your current directory when running the script.
Earlier versions of mongoimport.sh required you to have the CSV files in the same directory as mongoimport.sh, but as long as you have checked out the latest copy, you shouldn’t need that any more, but the first line of this comment is still true.
Thank you, but the make command (which I have just installed) isn’t working as expected
I’ll use WSL as Mark suggested.
Also, thank you for the comment about my presentation
Well, I am a macos user, and since I’m not using the system default python 2.0 and can’t replace it completely I have python3 and pip3 for my work code. Sometime around Catalina, I tried to dump 2.x and I had to make a speedy retreat. I only really use python in combination with Compass or with tensorflow anyway.
Thanks for letting us know about this @Fiewor_John. This is a bug that’s been introduced in a recent version of gdeltloader - it looks like it no longer works with Python 3.8.
I’ll fix the bug, but it’ll take a little while to publish. In the meantime, you can update to Python 3.10 to fix this problem. I’m sorry about this!