Commons talk:Video2commons

	SpBot archives all sections tagged with {{Section resolved\|1=~~~~}} after 1 day and sections whose most recent comment is older than 90 days. For the archive overview, see Special:PrefixIndex/Commons talk:Video2commons/Archive.

Archives

1, 2

Before you file a report, please check whether the following list already includes the problem you have.

Known bugs and common errors

Subtitles are not imported https://github.com/toolforge/video2commons/issues/148
Since circa 2020, subtitles have not been automatically imported even if the option is selected. Unknown cause, possibly bug in codes. Previous discussions: Commons_talk:Video2commons/Archive_2#Youtube_subtitle_not_imported Commons_talk:Video2commons/Archive_2#Not_importing_subtitles_from_youtube.--RoyZuo (talk) 17:04, 1 January 2023 (UTC)[reply]

Suddenly imports at low quality

Since recently, V2C in many cases imports files at low resolution. Did something change at YouTube, yt-dlp, or video2commons? I suspect the latter was changed somehow but it's also possible YouTube did something to the video formats which causes V2C to not download and convert the highest-quality video. In some cases, not importing the highest resolution files may be reasonable but not in these cases which are too useful and too low-resolution.

Examples:

As a workaround one can download the video with yt-dlp and then convert it using ffmpeg and upload it as a new version. I think the command is (example if it downloaded an mp4 as best quality) ffmpeg -i ./input.mp4 -vcodec libvpx-vp9 -acodec libvorbis "./output.webm". It's possible the yt-dlp command that video2commons uses to download the video from youtube should be changed to the one at: Help:Converting video#yt-dlp which would recode to webm if no webm is available at source. Prototyperspective (talk) 16:41, 30 September 2024 (UTC)[reply]

It seems the vp09.00.21.08 version was uploaded. I remember there was a similar bug last year. V2C only uploaded 144p versions. THROTTLED versions can't be retrieved without special permission. Yann (talk) 17:36, 30 September 2024 (UTC)[reply]

Well now the tool is half useless for uploading videos. It uploads some very low quality version of videos instead for every second video or so (another example). I'll submit a bug report at the GitHub repo along with some other issues like issues with importing audio files from soundcloud. It really needs some developers for that repo. Prototyperspective (talk) 15:42, 4 October 2024 (UTC)[reply]

$ ./yt-dlp -F https://www.youtube.com/watch?v=7DfSDCFgINE
[youtube] Extracting URL: https://www.youtube.com/watch?v=7DfSDCFgINE
[youtube] 7DfSDCFgINE: Downloading webpage
[youtube] 7DfSDCFgINE: Downloading ios player API JSON
[youtube] 7DfSDCFgINE: Downloading android player API JSON
[youtube] 7DfSDCFgINE: Downloading player 26636eff
WARNING: [youtube] 7DfSDCFgINE: nsig extraction failed: You may experience throttling for some formats
         n = 6GWRSI6cKA6W2Hk8Jw ; player = https://www.youtube.com/s/player/26636eff/player_ias.vflset/en_US/base.js
WARNING: [youtube] 7DfSDCFgINE: nsig extraction failed: You may experience throttling for some formats
         n = SBuXj8Wa65D2NZ8h4e ; player = https://www.youtube.com/s/player/26636eff/player_ias.vflset/en_US/base.js
[youtube] 7DfSDCFgINE: Downloading m3u8 information
[info] Available formats for 7DfSDCFgINE:
ID      EXT   RESOLUTION FPS CH │   FILESIZE   TBR PROTO │ VCODEC          VBR ACODEC      ABR ASR MORE INFO
─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
sb2     mhtml 48x27        0    │                  mhtml │ images                                  storyboard
sb1     mhtml 80x45        0    │                  mhtml │ images                                  storyboard
sb0     mhtml 160x90       0    │                  mhtml │ images                                  storyboard
233     mp4   audio only        │                  m3u8  │ audio only          unknown             [en] Default
234     mp4   audio only        │                  m3u8  │ audio only          unknown             [en] Default
139-drc m4a   audio only      2 │    2.23MiB   49k https │ audio only          mp4a.40.5   49k 22k [en] low, DRC, m4a_dash
139     m4a   audio only      2 │    2.23MiB   49k https │ audio only          mp4a.40.5   49k 22k [en] low, m4a_dash
251-drc webm  audio only      2 │    4.42MiB   97k https │ audio only          opus        97k 48k [en] medium, DRC, THROTTLED, webm_dash
140-drc m4a   audio only      2 │    5.92MiB  129k https │ audio only          mp4a.40.2  129k 44k [en] medium, DRC, m4a_dash
251     webm  audio only      2 │    4.36MiB   96k https │ audio only          opus        96k 48k [en] medium, THROTTLED, webm_dash
140     m4a   audio only      2 │    5.92MiB  129k https │ audio only          mp4a.40.2  129k 44k [en] medium, m4a_dash
394     mp4   256x144     30    │    2.55MiB   56k https │ av01.0.00M.08   56k video only          144p, THROTTLED, mp4_dash
269     mp4   256x144     30    │ ~  7.03MiB  154k m3u8  │ avc1.4D400C    154k video only
160     mp4   256x144     30    │    2.45MiB   54k https │ avc1.4D400C     54k video only          144p, mp4_dash
395     mp4   426x240     30    │    3.00MiB   66k https │ av01.0.00M.08   66k video only          240p, THROTTLED, mp4_dash
396     mp4   640x360     30    │    5.72MiB  125k https │ av01.0.01M.08  125k video only          360p, THROTTLED, mp4_dash
18      mp4   640x360     30  2 │ ≈ 15.81MiB  346k https │ avc1.42001E         mp4a.40.2       44k [en] 360p, THROTTLED
243     webm  640x360     30    │    6.38MiB  140k https │ vp9            140k video only          360p, THROTTLED, webm_dash
230     mp4   640x360     30    │ ~ 27.11MiB  594k m3u8  │ avc1.4D401E    594k video only
134     mp4   640x360     30    │    9.96MiB  218k https │ avc1.4D401E    218k video only          360p, mp4_dash
605     mp4   640x360     30    │ ~ 22.50MiB  493k m3u8  │ vp09.00.21.08  493k video only
397     mp4   854x480     30    │   10.36MiB  227k https │ av01.0.04M.08  227k video only          480p, THROTTLED, mp4_dash
398     mp4   1280x720    30    │   24.88MiB  545k https │ av01.0.05M.08  545k video only          720p, THROTTLED, mp4_dash
232     mp4   1280x720    30    │ ~ 89.12MiB 1952k m3u8  │ avc1.64001F   1952k video only
136     mp4   1280x720    30    │   33.63MiB  736k https │ avc1.64001F    736k video only          720p, mp4_dash
399     mp4   1920x1080   30    │   49.43MiB 1082k https │ av01.0.08M.08 1082k video only          1080p, THROTTLED, mp4_dash
270     mp4   1920x1080   30    │ ~162.86MiB 3567k m3u8  │ avc1.640028   3567k video only
137     mp4   1920x1080   30    │   57.71MiB 1263k https │ avc1.640028   1263k video only          1080p, mp4_dash

https://github.com/toolforge/video2commons/pull/225 .--RoyZuo (talk) 17:03, 4 October 2024 (UTC)[reply]

check these files https://commons.wikimedia.org/w/index.php?sort=create_timestamp_desc&search=deepcategory%3A%22Uploaded_with_video2commons%22+filewidth%3A640+filetype%3Avideo for lower-than-usual imports. RoyZuo (talk) 17:26, 4 October 2024 (UTC)[reply]

Thanks RuyZuo! @Don-vip has this not been deployed 3 days ago? Because the tool still uploads low-quality videos. Example.

The link showing low-resolution imports is also useful, too bad there's so many files of that kind now. I think those that are in used should be prioritized for checking and get a higher resolution upload asap. Prototyperspective (talk) 16:48, 8 October 2024 (UTC)[reply]

Some videos are really 480p max. RoyZuo (talk) 09:33, 12 October 2024 (UTC)[reply]

Sure, I did not mean to suggest otherwise. It would be great if there was some script that compared the highest resolution at source (e.g. using yt-dlp) and the resolution here. There also is Category:Videos imported from YouTube with lower resolution than at source which contains almost none of the files and it could be that more than half of the videos in your link are of that type (and many of them used or useful). Prototyperspective (talk) 11:06, 12 October 2024 (UTC)[reply]

Okay so the example above was 640 resolution max so it did import at highest quality.
I wonder if the issue is solved now as it seems, may be good if somebody could check...e.g. by checking the recent files in the link you posted. I think what it still needs is a scan that shows all videos that are in use or have been featured as MOTD that have been imported below source-quality so that these can all be replaced with the better-quality version. Also a way to search one's own uploads would be useful for the purpose of replacing one's uploaded videos with higher-quality versions – see phab:T188125. Prototyperspective (talk) 12:25, 30 November 2024 (UTC)[reply]

I think this script could be developed further to enable fixing all much-viewed, or in-use, or otherwise valuable videos that were imported at a quality below the source resolution. Prototyperspective (talk) 17:23, 16 January 2025 (UTC)[reply]

Possible to show what tasks have been queued up?

I just wonder, whether it's possible for the tool to have a page that shows info about all tasks that the servers are occupied with, and all tasks that have been queued up and waiting. it'd be helpful for everyone to monitor whether the tool is functioning properly.--RoyZuo (talk) 19:07, 18 November 2024 (UTC)[reply]

+1 — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 12:56, 19 November 2024 (UTC)[reply]

Also, record the time when a task is submitted and the time when the file is uploaded to commons / task fails. by showing the time taken it will let users have a rough idea of how busy v2c is. a similar design like User:SteinsplitterBot/Rotatebot. RoyZuo (talk) 18:49, 21 November 2024 (UTC)[reply]

Yes, that would be useful. Yann (talk) 19:16, 21 November 2024 (UTC)[reply]

This would be useful. The listeria bot now has a status page, maybe the code could be used and adjusted. Prototyperspective (talk) 15:12, 16 February 2025 (UTC)[reply]

TaskError: Exitcode: 153

I got this while trying to upload a big video: https://archive.org/details/le-mystere-de-la-tour-eiffel-the-mystery-of-the-eiffel-tower-1928-by-julien-duvivier An exception occurred: TaskError: b'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/12cb05f638e2ebdb/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -an -pass 2 -passlogfile /srv/v2c/output/12cb05f638e2ebdb/dl.mp4.an.vp9.webm.log /srv/v2c/output/12cb05f638e2ebdb/dl.mp4.an.vp9.webm\nExitcode: 153' Any idea? Thanks, Yann (talk) 14:00, 16 December 2024 (UTC)[reply]

Again a second time. Yann (talk) 16:38, 17 December 2024 (UTC)[reply]

https://github.com/toolforge/video2commons/issues/236

Again, same error message for https://archive.org/details/the-white-hell-of-pitz-palu-1929-by-arnold-fanck-and-georg-wilhelm-pabst Yann (talk) 18:07, 19 December 2024 (UTC)[reply]

Error

Error: An exception occurred: DownloadError: b'ERROR: [youtube] fRo8KXlqer4: Sign in to confirm you\xe2\x80\x99re not a bot. This helps protect our community. Learn more'

Of course, I'm logged on, so I don't understand what's going on here. TaronjaSatsuma (talk) 10:46, 8 January 2025 (UTC)[reply]

@TaronjaSatsuma: It appears that the video in question is restricted by youtube to the point that the tool is not allowed to retrieve it. What is the URL of that video, and what info did you try to add? — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 10:29, 9 January 2025 (UTC)[reply]

Last youtube upload appears to be File:Webinário Mais Povos 2022.webm.

06:01, 7 January 2025 Ana Vitória Farion (Projeto Mais+) talk contribs 1,101 bytes +1,101 Imported media from https://www.youtube.com/watch?v=K-rgH8hp2CI

v2c rate limited by youtube again? RoyZuo (talk) 11:26, 9 January 2025 (UTC)[reply]

I'm not sure if it's a rate limit, as I've queried over and over again for several days and I never get in. I think maybe certain channels will not allow it, as Jeff G. suggested above. —Justin (koavf)❤T☮C☺M☯ 22:02, 25 January 2025 (UTC)[reply]

You are logged in here (i.e. logged in to the video2commons tool via OAuth with your WMF credentials), but the bot that then queries YouTube is not itself logged in at YouTube. This is what is causing the problem. I have experienced the same problem many times for many days now, unfortunately. I have been able to get around it the very few times in the past that it's happened by just trying again later, but it's not working repeatedly now when I'm trying to port over any video from the White House's YouTube account, even tho I was able to do it several days ago. —Justin (koavf)❤T☮C☺M☯ 22:01, 25 January 2025 (UTC)[reply]

Does v2c need manual update when yt-dlp gets updated?

this youtube login problem seems to be resolved by the latest ytdlp version. i dont know which version of ytdlp v2c is using. RoyZuo (talk) 17:57, 3 February 2025 (UTC)[reply]

Is there a solution for it? TaronjaSatsuma (talk) 19:32, 8 February 2025 (UTC)[reply]

Strangely, in feb so far, apparently, 5 videos from youtube could be uploaded. like v2c could work for youtube very limitedly? RoyZuo (talk) 13:41, 16 February 2025 (UTC)[reply]

Tracked in GitHub
toolforge/video2commons/issues/237

So V2C currently is broken due to some YouTube changes and can't be used? I think this could maybe be solved by appending sth like this to the yt-dlp command --cookies-from-browser firefox and having a YT account for video2commons with the cookie on that server. Created the issue. Prototyperspective (talk) 13:44, 2 March 2025 (UTC)[reply]

Please add this as a standard error

Something like:

Error: An exception occurred: DownloadError: b'ERROR: [youtube] TWZu9709D3A: Sign in to confirm you\xe2\x80\x99re not a bot. This helps protect our community. Learn more'

And preferably add a reason. I would add it myself, but I feel like I may interfere with the documentation and don't want to undermine what the maintainers are doing. —Justin (koavf)❤T☮C☺M☯ 22:03, 25 January 2025 (UTC)[reply]