Dustin at Github - Latest Comments

Re: GoPro Plus

David Klein — Wed, 20 Sep 2023 03:49:16 -0000

Amazing, this ir really helpful - I’ll give it a go. Thank you so much!

Re: GoPro Plus

dustin — Wed, 20 Sep 2023 01:03:43 -0000

Hey! After you've done your sync successfully, you just need to run `gopro backuplocal /some/path`

That should grab all your primary media and store it in `/some/path` – could take a while. I usually add a `-v` in there (e.g., `gopro -v backuplocal /some/path`

This is resumable, so if anything starts acting weird, you should be able to just delete it and start over.

One thing I did notice and haven't got around to looking into more is that sometimes the actual download mechanism fails in a weird way that successfully gives me an error in an XML file instead of the file they were supposed to be sending me. You can always delete any directory that doesn't look like it contains all the right stuff and rerun the backups.

I've got nearly 18TB in a bit over 6,000 media items, so I've seen a few things. heh

Re: GoPro Plus

David Klein — Tue, 19 Sep 2023 09:35:32 -0000

Hi Dustin, this is great, thank you so much! I no longer have need for GoPro Cloud and want to move everything as video files to my local HDD instead, but I'm getting a little lost in the documentation - what steps should I take if I'm looking to download everything from the cloud into individual video files in one go? I have got as far as `gopro sync`, but that seems to just update my gopro.db file.

Re: GoPro Plus

dustin — Tue, 20 Dec 2022 15:19:49 -0000

I believe it's working. I get errors every once in a while, but I just did a `gopro sync` (which includes the search call) and it worked OK. There are probably some things that might be upsetting it, though. If you'd like to email me an example request, I can see if there's anything obviously wrong in it.

Re: GoPro Plus

Frank — Tue, 20 Dec 2022 02:36:15 -0000

Hi Dustin, is your tool still working for you? I am doing reverse engineering as well and get 403 forbidden error from my postman search API test call. Are you getting the same error ?

Re: GoPro Plus

Mark Cross — Fri, 11 Nov 2022 02:12:18 -0000

Wow, thank you so much!

Re: GoPro Plus

dustin — Fri, 11 Nov 2022 01:08:32 -0000

Individual file download works now using the same mechanism as backup, but allowing you to specify a media IDs.

Combined with sqlite commandline, you can do stuff like download the last 10 things you've uploaded:

gopro download /some/location `sqlite3 gopro.db 'select media_id from media order by created_at desc limit 10'`

Re: GoPro Plus

🍓Danell looking for sex🔞 — Sun, 06 Nov 2022 18:13:25 -0000

Wow. Not bad...

Re: GoPro Plus

dustin — Sun, 06 Nov 2022 17:59:45 -0000

I filed https://github.com/dustin/g... for making this download command. I'm still working on a conflicting project, but I do think this is pretty straightforward after that.

Re: GoPro Plus

Mark Cross — Tue, 01 Nov 2022 15:52:16 -0000

Hi Dustin,

I couldn't get UI up and running:-( only because I couldn't work out the parameters!

The only reason I'm in this situation is that that gopro cloud Web share to YouTube does not actually work. Whatever the edge case is , there must be just a handful. As there are a few on the community with exacthe same issue. Share to yt, says it's doing it with the green bar at the top, then nothing.

So it's VPS + x2go then destroy after use. Or find a way to locally download to my ordinary VOS account and click upload to youtube, thank you for coming back to me. Cheers

Re: GoPro Plus

dustin — Mon, 31 Oct 2022 17:41:37 -0000

I'm not ignoring you, but I've been working on something that kind of has a lot of overlap so doing both at the same time would just cause me more trouble. I like your ideas, though.

I live on a tiny island in the middle of the Pacific -- not the same one I started using GoPro Cloud on, but, strangely, I've got really great connectivity here. I didn't have good connectivity for a long time, so I've got a few tools to compensate (including `gopro upload` which has generally treated me a lot better than having the cameras do it). I have a similar thing called `s3up` that will upload an arbitrary large file to S3 with the ability to resume across any type of disruption. I generally edit my stuff in Davinci Resolve before uploading to YT, but didn't even realize CLI uploads to YT was an option. That might be neat.

I think it'd be nice to not only support downloading individual media, but also, similar to what you were saying with the `--creation` flag, based on a query. I'm not 100% sure what this new API I'm playing with will allow, but I'd personally like something like:

gopro download /whatever 'select medium_id from whatever where camera_model = x and created_at between b and e`

One could theoretically just make an additional relation to specifically mark the ones that should be pulled.

The same interface would allow for

gopro download /home/markc/gpp/media LvJEV8zMNnP9B

Re: GoPro Plus

Mark Cross — Sun, 30 Oct 2022 06:16:52 -0000

Hi Dustin,

> I imagine it wouldn't be too hard to make an "export" command to grab the content for a single medium.

Thank you for such a prompt reply, I think that might be beyond my time allowance.

But I may pay someone on fiverr to do it.

I live on a narrowboat in the UK and this would be perfect.

Shoot footage
Leave goPro on overnight to upload
install you app on VPS
Download MP4s
Upload to youtube via CLI on the VPS

As the "https://plus.gopro.com/medi..." share to youtube appears to a non functional item for 4k, not that I have been able to get it to work at all.

But if I manually upload to youtube with same video, it works perfectly as I have enabled the new youtube channel for the longer duration videos, so this is extremely frustrating.

I am thinking for the time being I will have a VPS with Desktop on and use via x2go

So my fiverr hire would be for:

gopro -i LvJEV8zMNnP9B backuplocal /home/markc/gpp/media
for a single pull

gopro --creation YYYY-MM-DD XX backuplocal /home/markc/gpp/media

Where XX is day(s) backwards in time from the date input

These are my thoughts so far. Any other anyone else would like to contribute?

My first day with the GoPro

Cheers Mark

Re: GoPro Plus

dustin — Sat, 29 Oct 2022 20:59:36 -0000

Hi. I don't have a way to download individual files. I do a full sync after uploading a batch and run `backuplocal` to keep a copy of the entire data set. I imagine it wouldn't be too hard to make an "export" command to grab the content for a single medium.

The web UI just lets you browse what you've sync'd. The primary thing it did for me was let me look at specific media from a specific point in time. e.g., I can select a few days from the calendar and maybe limit it to a particular camera or medium type. It's very much "works for me" for fairly specific things. What do you imagine would work for you?

Re: GoPro Plus

Mark Cross — Sat, 29 Oct 2022 18:47:04 -0000

Hi Dustin,

Your magic tool might just do what I am after but I am struggling with the docs slightly.

gopro backuplocal /home/markc/gpp/media

This works for me fine, I understand and it did start pulling down the lot.
But what if I am looking to download individual files, I am expecting a syntax like this:

gopro -i LvJEV8zMNnP9B backuplocal /home/markc/gpp/media

If I go with the former that I can get to work, can I delete a locally downloaded file and will it or won't it download it again the next time the backuplocal is run again? Or does the db keep track of what has been locally downloaded?

Also I cannot fathom the gopro serve UI set up at all :-( Any help appreciated.

Many thanks,

Mark

Re: GoPro Plus

dustin — Wed, 18 May 2022 00:11:29 -0000

Thanks. Yeah, I do end up doing a local backup of all that stuff, but it's nice to not have to worry about it.

Re: GoPro Plus

Dale Berry — Tue, 17 May 2022 04:00:02 -0000

You are a legend. This is great stuff, thank you.

I actually wish there was a way I could just hijack the auto-upload feature to back it up to my local server.

For now, I'll just use GoPro's and periodically back it up.

Thank you!

Re: GoPro Plus

dustin — Sat, 26 Mar 2022 11:19:41 -0000

This is kind of interesting. Fairly recently, I added code to identify filenames based on the filenames GoPro cameras create: https://community.gopro.com...

I added this code for two reasons:

1. To ignore THM/LRV files when uploading *
2. To automatically group multipart files into a single medium.

There's no need for it to be this strict for anything matching JPG, but in the meantime, if you rename the file to 'GXXXNNNN.JPG' it where XXX is three arbitrary characters and NNNN is four numerical digits, it shouldn't reject them at this level. I'll fix that up pretty soon, though.

Re: GoPro Plus

Ron — Sat, 26 Mar 2022 09:51:31 -0000

Hi Dustin, this looks pretty cool. I was able to get everything synced locally but I'm having a hard time uploading, maybe I'm not using it right? It seems it doesn't matter what I try to upload, it keeps saying Ignoring some unknown files. For example:

gopro upload ~/Pictures/Misc/*.JPG
I: Ignoring some unknown files: ["/Users/***/Pictures/Misc/IMG_7779.JPG"]
I: Have 0 media items to upload in 0 parts with a total of 0 chunks (0 MB)

Am I missing something? Thanks

Re: GoPro Plus

dustin — Sat, 29 Jan 2022 16:09:01 -0000

You only need an amazon bucket if you're wanting to do the backup thing where you extract all of your data from GoPro into your own bucket. I've done that ~once.

GoPro defines all of the Amazon buckets for normal operations. You provide some metadata describing what you want to upload and they give you a collection of URLs for chunks of the file to upload. I've not looked at the actual upload URLs lately, but if this is a thing they do, it should transparently work. I'm not 100% sure about whether I have any control, but I don't think so.

Re: GoPro Plus

Jon — Sat, 29 Jan 2022 15:44:30 -0000

that sounds great actually, pretty simple !

I have the opposite problem, I have great fast upload speeds from my provider but the gopro desktop app is rediculously slow.

Do you manually set the amazon bucket URL for the uploads or is that something that you get from the calls to amazon.

I read here that there may be speed efficiency if the upload url were changed from :
https://gopro-media-uploads...

instead of

https://gopro-media-uploads...

information found here
https://community.gopro.com...

really love the work you have done. I will try and find some time to help on the web ui, i just need to start getting my head around haskell!

Re: GoPro Plus

dustin — Sat, 29 Jan 2022 15:30:09 -0000

Yep. Uploads were a huge thing for me when I started because my rural connectivity was unusably bad. :) The GoPro UI was pretty terrible when I started, but it's a lot better now. I can do fancier things in mine, but I don't use it all that much.

There's no useful duplicate detection, so just like, don't upload things you've already uploaded. :) It's *possible* to do duplicate detection, but there's no useful identification without looking at all the bits (which is possible, but I've not bothered with it).

Uploading multiple is pretty easy, though. The "upload" command is composed of a function that creates uploads and a function that finishes them. You can do them separately (by running the "createupload" command first, and then just using "upload" with no arguments to finish).

So if you have a giant collection of media, you can do something like "gopro createupload allmymovies/*.MP4 andmyimages/*.JPG" and then just occasionally run "gopro upload" from the same directory to have it make progress. You just have to make sure you're always running the "gopro" command from the same directory as it keeps its data locally.

You'll notice if you just run "gopro upload" it spits out a status of what it's got to do.

Note that if you have things like image collections that make up time lapse, you can create those separately with "createmulti" but otherwise, approximately the right thing should happen doing the easy thing (because I also had a ton of that).

Re: GoPro Plus

Jon — Sat, 29 Jan 2022 14:31:59 -0000

To be honest I give up with windows natively and im running it on ubuntu on windows subsystem, its running pretty well.

It's the uploads Im most interested in as the performance of the uploads are sooo much better with this tool. One thing i wanted to know is do you have any way of syncing the local media library up to gopro plus. I need to get nearly 700GB back up of which 200GB has already gone up. Is there any way to check if the media is already up there before trying again?
Or do you just have to upload them individually one by one (which at the moment im building a little bash file for)

There are so many people on the gopro forums complaining about upload speeds it would be great if I can get this to work for many files.

Re: GoPro Plus

dustin — Sat, 29 Jan 2022 14:25:11 -0000

Oh cool. I have no idea how anything on Windows works. I do use ffmpeg via subprocesses for extracting metadata from video files. Primarily, it's used to extract a single stream of the data. It would be nice to be able to do that in-process, but mpeg libraries are both very lacking in ergonomics *and* more difficult to get going than just using ffmpeg.

Re: GoPro Plus

Jon — Fri, 28 Jan 2022 08:01:10 -0000

I cant believe that im the first here, this looks like an awesome tool, especially given that gopro ended support for windows desktop. Not played with haskell but looks like i can get it going on wind 11 so ill give it a go! thanks!

Re: Pools in Go

pontusrydin — Fri, 21 Sep 2018 09:07:49 -0000

Great algorithm! I just used here: https://github.com/wavefron...
Thanks for sharing!