Help talk:FastCCI

From Wikimedia Commons, the free media repository
(Redirected from Help talk:FastCCI/es)
Jump to navigation Jump to search
SpBot archives all sections tagged with {{Section resolved|1=~~~~}} after 20 days.
Technical background: “FastCCI - Taming the Commons Category Tree.” Dschwen, Wikimania 2014
Technical background: Talk: “FastCCI - Taming the Commons Category Tree.” Dschwen, Wikimania 2014

Interaction with Gadget-CategoryAboveAll

[edit]

The gadget interacts weirdly with MediaWiki:Gadget-CategoryAboveAll.js: the FastCCI QI boxes get added before the category bar. Not sure if this should be fixed here or over there :)

Jean-Fred (talk) 17:12, 7 January 2014 (UTC)[reply]

Thanks for the bug report Jean-Fred. I'm not happy with the button box of this gadget yet. I think I'll want the buttons to go horizontally next to the category title. I'm currently focussing on backend work. I'll get back to the frontend stuff when I have important functionality completed there. --Dschwen (talk) 17:54, 7 January 2014 (UTC)[reply]
Thanks for the answer Daniel. Sure, I totally understand you rather focus on the backend code :-)But I notice that the problem was solved already − thanks! Jean-Fred (talk) 00:02, 8 January 2014 (UTC)[reply]

Question, bug and suggestion

[edit]

Anyway, great work, thanks! -mattbuck (Talk) 22:50, 12 January 2014 (UTC)[reply]

  • Hi Mattbuck, I had the buttons in the bodytext initially, but they were causing conflicts with a variety of other gadgets and templates on the cat pages :-(. I'm still looking for a better solution. I think I can make the text non-selectable, which should solve your issue. However I'm on a weak hotel connection right now. --Dschwen (talk) 23:50, 12 January 2014 (UTC)[reply]
  • The strength-of-match slider determines the depth in the category subtree images are taken from . Your example category does not have any subcats, so the slider does not do anything. Try it in Category:Green_in_nature for example. --Dschwen (talk) 23:55, 12 January 2014 (UTC)[reply]
  • Hmm, it is possible that results from the level 7 subcats are not shown. I'm pulling 200 results now. I'll add a more... link to fetch the next 200 and so on. If you feel adventurous, use the element inspector in Chrome for example and look at the css classes on the result images. They will tell you the level. The result level value is the sum of the depths of the images in the two categories. I'm actually not sure if the count starts at 0 or 1... --Dschwen (talk) 00:25, 14 January 2014 (UTC)[reply]
  • Another thought regarding the slider: I agree that the current strong/weak labeling is fuzzy. But it is deliberately so, because the meaning associated with depth in our complicated category tree is rather fuzzy as well. There is no good rule as to which separation distance in the category tree corresponds to which strength of a relation. That is why the concept of a fuzzy slider that you just pull to change the results in real time seemed attractive to me. --Dschwen (talk) 00:28, 14 January 2014 (UTC)[reply]

A good test

[edit]

This is a good pilot project how to enable three different things:

  • optional filtering of the content of categories (see Bug 59108)
  • direct display of the content of subcategories (see Bug 43424)
  • changing and setting of the format how categories display their content (display size, suppressed filenames etc.)

All three features should be enabled for substantially broader use than only for valued images. --ŠJů (talk) 14:30, 14 January 2014 (UTC)[reply]

Its not only VI but also FP and QI, but I get your point. Your first bugreport is quite a tall order! The fastcci system can and will deliver arbitrary category intersections. I am currently working on the userinterface for this! --Dschwen (talk) 16:49, 14 January 2014 (UTC)[reply]
Thanks for a remark. It is too profligate to occupy the headline of all categories with 3 links to 3 various types of valued images with three different names. A tool which enables to display the best files is useful, but it's not so necessary to present a competition of three different processes of evaluation of the best images so obtrusively (the links can look as a bit snobbish from the view of the whole scope of the project: most of categories contain none such labelled image). One link can be sufficient for the future. The first linked bugreport is not so exaggerated. But it call rather for a systematic and universal solution instead of accidental and unbalanced implementation for particular and very limited purposes. I'm awaiting a more universal tool eagerly! --ŠJů (talk) 18:15, 14 January 2014 (UTC)[reply]
Wow... ok... sure. --Dschwen (talk) 18:46, 14 January 2014 (UTC)[reply]
Took me a while to digest your comment.. Anyhow, I did not mean to imply that the bugreport is exeggerated or unreasonable, rather that it is a lot of work to implement. The UI of the fastcci gadget is certainly not finalized. I have already thought about a single button solution. --Dschwen (talk) 20:56, 14 January 2014 (UTC)[reply]
Just remember to include non-intersections, eg Category:Cats and not Category:Dead animals. -mattbuck (Talk) 22:39, 14 January 2014 (UTC)[reply]
Yeah, the server code for this exists (but needs a bit more testing). --Dschwen (talk) 22:48, 14 January 2014 (UTC)[reply]

Buttons don't look like buttons

[edit]

Hi,

The three buttons don't look like buttons to me. Firstly, they don't have a pointer cursor when hovered nor a tabindex. Though they are made with an <a> tag, that doesn't provide a pointer cursor nor does it add the element to the tabindex list (that only happens if there is an "href" attribute present, at which point the click handler needs to prevent the default action to avoid anchor jumping). Right now it might as well be a <span>. Secondly, they use styling unlike any button anywhere else (they don't look like native form buttons, not like jQuery UI buttons, not like MediaWiki UI buttons, ...).

In part due to them not looking or behaving like buttons, my first thought when I saw them (not knowing anything about this gadget, as most users would) I thought they were assessment badges (e.g. indicating that this category has been nominated or classified as being Values, Quality and Featured, which seemed most unlikely, hence I started digging looking for a bug, but finding it is by design). –Krinkletalk 23:18, 15 January 2014 (UTC)[reply]

The cursor changes for me. -mattbuck (Talk) 00:04, 16 January 2014 (UTC)[reply]
@Krinkle: Hm, they have a pointer cursor for me (latest Chrome and Firefox). But point taken. They need to look more buttony. I'll change the UI in any case to include more powerful category operations in a popup menu. --Dschwen (talk) 00:05, 16 January 2014 (UTC)[reply]
@Dschwen: Note that I fixed the cursor thingy in Revision #114050936 (edited one minute after I posted this, about 30 minutes before the both of you replied). Depending on whether you observed it before that as well, you might've just seen the new behaviour. Either way, good now. –Krinkletalk 00:32, 16 January 2014 (UTC)[reply]
Yeah, got it, but I'm sure it was a pointer before, at least in chrome. That was the reason I switched early on from span to a. --Dschwen (talk) 00:33, 16 January 2014 (UTC)[reply]
Well, I'm using Chrome and it definitely wasn't showing a pointer for me when hovering. It only does that when the element has an "href" attribute (and to my knowledge always has..). Could be a bug in the platform logic (e.g. Windows/Mac difference, though one would assume this is in the platform-neutral shared code of Chromium). –Krinkletalk 00:54, 16 January 2014 (UTC)[reply]

Current usage

[edit]

The backend currently gets about 6200 requests per day. I estimate that it could easily handle 30000-60000 per worker node. And I have a few more optimizations in mind. --Dschwen (talk) 19:24, 17 January 2014 (UTC)[reply]

i18n

[edit]

Since this is now activated by default for everyone it would be nice if the UI messages could be translatable. If translatewiki is an issue at this stage of development then maybe just a page in the MediaWiki namespace on Commons? /André Costa (WMSE) (talk) 12:33, 23 January 2014 (UTC)[reply]

And since this wasn't obvious from my initial comment... I really like this feature! Didn't know I was missing it until I spotted it =) /André Costa (WMSE) (talk) 12:34, 23 January 2014 (UTC)[reply]
hi Andre. I agree about i18n. Do you have a pointer for me how to best do it? How can I get this to work efficiently with resource loader? --Dschwen (talk) 17:34, 23 January 2014 (UTC)[reply]

Add button for unfiltered content

[edit]

It is an interesting tool but I'm not sure it's adequate to display such big buttons at every category page. Modestly estimating, only less than 1 percent of all categories contain some image of the three filtered groups of selected images. This tool is useful for the biggest top categories only, or for categories of several most interesant objects or items, not for majority of subjects and categories of Commons. Maybe, a button enabling to hide or minimalize the buttons (as a personal setting) would be useful.

However, a small improvement can made this tool useful for all categories which have at least one subcategory. The 4th button (or rather the first button) should be added which would display unfiltered all images from several/all levels of subcategories. Such button can compensate disadvantages of detailed category tree. I think, it is a realistic request which can be satisfied promptly, isn't it?

Prospectively also a customization button which would enable to choose other filters instead of the three current ones. I think, some other filters would be technically very similar to the three used now. E.g., "PD images", "images from my user gallery" or "files with coordinates". --ŠJů (talk) 15:04, 27 January 2014 (UTC)[reply]

Hello ŠJů. That button could be implemented immediately (the backend supports it). But rather than adding a 4th button I would like to redesign the interface and make it more compact. Then I will also add arbitrary intersections. --Dschwen (talk) 15:35, 27 January 2014 (UTC)[reply]

UI redesign

[edit]

I just switched over to a new user interface for the FastCCI gadget with a simplified one button solution. I figured that people who are not intimately familiar with Wikimedia Commons may not know the what our assessment projects mean. So instead of having three buttons (for "Featured pictures", "Quality images", and "Valued images") I have now one button which returns all of the above (with FPs listed first and so on).

In the results a little badge is shown for FP/QI/VI images (currently only the highest merit is displayed).

Next to the new "Easy button" is a button to open the advanced menu which includes the old way of listing FP/QI/VI separately, listing all images in a category subtree, and (coming soon) arbitrary intersections and 'not' operations.

This comes with changes on the server side, where i simplified the code a lot. --Dschwen (talk) 02:57, 4 February 2014 (UTC)[reply]

Current Wikimedia bugs affecting this gadget

[edit]

There are two open Wikimedia bugs (I know of) that affect the operation of this gadget:

  • bugzilla:52630 Fix certificate chain issue for tools.wmflabs.org - Causing the SSL certificate of WMFLabs not to be trusted on Android devices (the gadget will habg with a Connecting... message)
  • bugzilla:60810 Thumbnails fail to generate (304 Not Modified - Error) - Responsible for some of the result thumbnails not showing up.

Cheers --Dschwen (talk) 13:55, 4 February 2014 (UTC)[reply]

Some improvement proposals

[edit]

Hi. Thank You very much for the recent enhancement. I have some ideas what can be improved more.

  • To add a number (count) of selected (displayed) images. If the number is limited, add also the information that not all images are displayed (e.g. "200 from 1437 images displayed").
  • To add a help to the term "strong/weak match" (it's not just clear) and specify its values - a depth of subcategory levels (as a numeral scale or as a balloon help?).
  • To make possible to display the selected images in standard format how images are displayed at category pages, including a possibility to select and categorize the displayed images through Cat-a-lot etc. --ŠJů (talk) 23:37, 4 February 2014 (UTC)[reply]
Thanks for the suggestions I will keep them in mind. The number is a work in progress, the server does return the necessary data (but recent work broke the number estimates). And yes the total number will have to be an estimate (ie. 200 of about 1400 images shown) for technical reasons (the processing stops once the desired number of results is found. The balloon help is a good idea. The standard display should be doable and I will look into that (Cat-a-lot support is a neat idea I haven't thought of yet). I have some higher priorities first though, adding a more... link to fetch the next bunch of results is high on the list, and I want to finish the UI for arbitrary intersections (the currently disable menu entries). --Dschwen (talk) 23:43, 4 February 2014 (UTC)[reply]
Server commit for result size estimates: https://github.com/Commonists/fastcci/commit/fab11d613656ca364e9bb3dea37f350b7b4d3c77 --Dschwen (talk) 00:07, 5 February 2014 (UTC)[reply]

Thank You for your answers.

As I just noticed, the result is not quite complete - the latest images are not included in the result (maybe, due to a delay of indexing - several hours, or even days?). Could you add any short warning or explanation about it to the result display? --ŠJů (talk) 00:42, 7 February 2014 (UTC)[reply]

I'll document this on the help page. I would like to keep the UI as clean as possible. The DB is rebuilt every 4h. Did you find any cases where the delay is significantly higher? (an additional source of delay could be tool labs database replication lag, but I think that is currently not an issue) --Dschwen (talk) 02:17, 7 February 2014 (UTC)[reply]
Oh crap, the update process hasn't run for over 12h. gunzip gives a segfault. What up?! --Dschwen (talk) 02:21, 7 February 2014 (UTC)[reply]
Fixed. I might have the server return the database timestamp with the results. That might be a useful thing after all. --Dschwen (talk) 03:22, 7 February 2014 (UTC)[reply]
With this commit the server now reports a timestamp. I'll still have to add this to the UI. --Dschwen (talk) 17:53, 7 February 2014 (UTC)[reply]

Advanced UI - Arbitrary intersections

[edit]

I just activated the UI for arbitrary intersections and 'not' operations. Try for example going to Category:Wyoming and doing an intersection with Bison. --Dschwen (talk) 18:28, 10 February 2014 (UTC)[reply]

H*ly fuc*ing sh*t. This is all kinds of awesome Daniel. Seems to work like a charm.
Feature request: could the bread crumbs display both paths? for example, on File:Morning_Bison_(7467045148).jpg in your example it would display both « Wyoming → Geography of Wyoming → Jackson Hole → National Elk Refuge » and « Bison → Unidentified Bison ».
Thanks! Jean-Fred (talk) 19:01, 10 February 2014 (UTC)[reply]
Yes, I have that in the back of my mind already. --Dschwen (talk) 19:32, 10 February 2014 (UTC)[reply]

Bug (2)

[edit]

I keep encountering randomly this bug. Only logged in so maybe a fishy interaction with another gadget?

Here is the error message:

Error: https://bits.wikimedia.org/commons.wikimedia.org/load.php?debug=true&lang=fr&modules=ext.gadget.fastcci&only=scripts&skin=vector&version=20140301T093952Z&* at line 205: : 

(This was with ?debug=true. Not sure how I could get you more debugging data?)

Cheers, Jean-Fred (talk) 15:22, 1 March 2014 (UTC)[reply]

That's it? Nothing after the colon? Hmm. This is odd, because line 205 only contains a comment :-/ --Dschwen (talk) 17:21, 1 March 2014 (UTC)[reply]
Oh, no, wait. Line numbers are shifted by one by the resource loader. The offending line is
var ws = new WebSocket('wss:' + url + '?' + $.param(params));
Let me think what could go wrong here... --Dschwen (talk) 17:23, 1 March 2014 (UTC)[reply]
may be helpful to know what the browser is supposed to do but couldn't find anything that would explain that odd error -- Rillke(q?) 14:17, 21 March 2014 (UTC)[reply]
@Jean-Frédéric: Does this still happen. Which browser are you using? -- Rillke(q?) 14:17, 21 March 2014 (UTC)[reply]
Firefox, latest under Linux Ubuntu. Not sure if it happens again, I’ll keep yu posted. Jean-Fred (talk) 10:47, 10 May 2014 (UTC)[reply]

Wikimania 2014

[edit]

I've submitted a talk about FastCCI and Commons Categories for Wikimania 2014. I'd be happy about suggestions for improving the abstract. Anything in particular that might interest the potential audience? --Dschwen (talk) 20:14, 5 March 2014 (UTC)[reply]

If I should be able to attend Wikimania, I would be particulary interested in the backend. How did you make it so fast? (I know it's open source but it would be very nice to get everything explained) -- Rillke(q?) 14:21, 21 March 2014 (UTC)[reply]
Sure, the backend will be explained. But it is quite frankly embarrassingly simple. Surprising that this hasn't been done before... --Dschwen (talk) 14:30, 21 March 2014 (UTC)[reply]
[edit]

Currently the interface doesn't indicate where the tool is documented, which can cause some frustration. How about linking to this Help page from an "About this tool ..." item in the righthand dropdown menu? --Avenue (talk) 05:57, 26 March 2014 (UTC)[reply]

I've implemented that but I am not sure whether it fits in the author's philosophy and may be reverted as there is another help link after clicking the "Good images"-button. -- Rillke(q?) 09:49, 26 March 2014 (UTC)[reply]
Thanks for doing that. I think the other help link doesn't show up if the tool fails to find any matches, which seems like a situation where it could be useful. --Avenue (talk) 11:25, 26 March 2014 (UTC)[reply]

Half-hidden in hebrew.

[edit]
This is how it being shown to me.

The FastCCI don't works in the hebrew version of commons. I use Opera browser, Win7 OS.

Yikes, of course. I have to add some RTL fixes. Thanks to the note! --Dschwen (talk) 14:59, 22 April 2014 (UTC)[reply]

Suggestions

[edit]

A number of suggestions:

  1. Add "Good pictures" to the drop-down
  2. Change the button to show the active search instead of always showing "Good pictures". ie Change it to Featured when the query is for FPs
  3. If the query is for only one of FP/QI/VI don't show the badges on the results - its implicit in those cases.
  4. If the query is for all or good images, don't just show the "highest". QI does not "outrank" VI after all - and VI may give better results depending on what the user is after.
  5. Allow the user to change the default query.
  6. Suppress the regular display of images in the category when the gadget is active (no need to show both the FastCCI-generated thumbs and the default ones), but retain other info (like parent cats).

I also think everything about the tool is playing up the "good pictures" utility too much, ignoring the "all pictures" as a result. All picture can be more useful in some cases (eg if there are no good ones). I'd suggest the pre-activation button is adjusted to something like "See related images" (emphasizing function). When it becomes active and displays "Good pictures", the user is more likely to realise the search can be broadened to include non-good images. If the good pictures query returns zero, a prompt saying "No good pictures found, do you want to see all pictures?" would be beneficial too. The documentation should also be adjusted to mention that it can be used for all images.--Nilfanion (talk) 01:04, 4 May 2014 (UTC)[reply]

Bug on line 276

[edit]

Encountered that one: Error: https://bits.wikimedia.org/commons.wikimedia.org/load.php?debug=true&lang=fr&modules=ext.gadget.fastcci&only=scripts&skin=vector&version=20140510T083430Z&* at line 276: : Jean-Fred (talk) 10:49, 10 May 2014 (UTC)[reply]

which is again
var ws = new WebSocket('wss:' + url + '?' + $.param(params)); -- Rillke(q?) 11:27, 10 May 2014 (UTC)[reply]
Ugh, Error is not a super helpful error message :-). Does it show up consistently? (which browser?) --Dschwen (talk) 04:48, 11 May 2014 (UTC)[reply]
See #Bug (2). Jean-Fred didn't change the browser, I think. -- Rillke(q?) 12:55, 11 May 2014 (UTC)[reply]
I notice that Modernizer also tests window.WebSocket.CLOSING === 2. -- Rillke(q?) 12:55, 11 May 2014 (UTC)[reply]

How often are 'Good pictures' updated?

[edit]

I have noticed that recently promoted VI, QI & FP are not included as 'good pictures' when clicking on the button in the relevant categories. Is this because the system is updated less regularly.58.106.242.26 02:45, 1 June 2014 (UTC)[reply]

Thumbnail requests

[edit]

Hi,

When using pages like these, there are a lot of network requests to thumb.php such as https://commons.wikimedia.org/w/thumb.php?w=445&f=Flowers_on_tree_at_Greenway_-_geograph.org.uk_-_1355217.jpg. These seem relatively slow (200 OK instead of 304 Not Modified) and seem to bypass cache server-side cache as well (generates a new thumbnail). Thumbnail urls used by native interfaces from MediaWiki don't do this. FastCCI should use the imageinfo API to get the correct thumbnail urls (either in batches afterwards or without extra requests using generators), or use Special:Redirect to redirect to the proper thumbnail url (e.g. Special:Redirect/file/Example.svg?width=400 redirects to upload.wikimedia.org/.../commons/thumb/.../400px-Example.svg.png). –Krinkletalk 12:43, 23 June 2014 (UTC)[reply]

I'm using the API already. I'll see if I can pull the ImageInfo data as well. Thanks for the pointer! --Dschwen (talk) 19:02, 23 June 2014 (UTC)[reply]

Broken. Can not turn off or reset

[edit]

I do not see an "x" on the dropdown menu. No easy way to close the menu.

Once one clicks the top of the menu as an attempt to close it, some larger images show up. But I don't know what they are, because I don't remember what I clicked. Need a title at the top of the image stack.

Finally, I see no way to get rid of the image stack. Again, nothing intuitive like an "x".

So I am going to disable this gadget for me. I am not sure you should bother to tell me how to do these things, because I won't remember once I am away from this talk page.

I frequently notice that developers often do not know how to make things intuitive. --Timeshifter (talk) 18:12, 14 July 2014 (UTC)[reply]

I remember jQuery using $(document).one(/* handler */) to allow people clicking anywhere to close a menu. -- Rillke(q?) 18:34, 14 July 2014 (UTC)[reply]
I tried clicking everywhere. Nothing worked that I can remember. That's the problem; it changes depending on the gadget, infobox, menu, etc.. Just like only allowing icons at the top of menus, or in many other places. Another bad idea. Show/hide arrows come to mind. There should always be an option somewhere in preferences for minimal text to replace icons. Even for the "x". A tooltip for everything at the very minimum. And the option for text instead of icons. --Timeshifter (talk) 14:56, 15 July 2014 (UTC)[reply]
Title at the image stack is going to happen soon. Adding an X to remove the results should be trivial. So would be the click anywhere to close the menu. I'll make sure not to notify User:Timeshifter! --Dschwen (talk) 22:23, 14 July 2014 (UTC)[reply]
Thanks all for the rapid replies and everybody's work. But don't notify me about clicking anywhere to close the menu. That is not enough. Please notify me, and everybody else, about the "x" and the image stack caption at the top. :) --Timeshifter (talk) 14:56, 15 July 2014 (UTC)[reply]

The Perennial Question

[edit]

Is there any way that FastCCI could be adapted (without a huge amount of work) to allow displayed images to be selected with Cat-a-lot, since it runs on Commons rather than externally? That would allow quick moves from an intersection into a subcategory (a long-desired feature, which to my knowledge has never been implemented - right now such moves have to be clunkily done from each of the original categories). Pi.1415926535 (talk) 14:22, 29 July 2014 (UTC)[reply]

Currently there is no space -- so Cat-a-lot would have to capture the click event on the thumbnail or it would have to add a . -- Rillke(q?) 15:08, 29 July 2014 (UTC)[reply]
BTW, FastCCI as a data source for VisualFileChange would be great... -- Rillke(q?) 15:09, 29 July 2014 (UTC)[reply]
Are you going to be at Wikimania? I won't havetime to do anything before London, but maybe we can sit down for a while. I don;t have much experience with VisualFileChange (or Cat-a-lot). I'm sure together we could implement this much faster. --Dschwen (talk) 14:35, 30 July 2014 (UTC)[reply]
Sadly I'm not able to be there. I have very little coding experience but I'll dig around in cat-a-lot to see if I find anything interesting. Pi.1415926535 (talk) 15:14, 30 July 2014 (UTC)[reply]
If you would submit a patch before London, I would review it. -- Rillke(q?) 15:55, 30 July 2014 (UTC)[reply]

Wikimania presentation

[edit]
FastCCI - Taming the Commons Category Tree. Dschwen, Wikimania 2014
Talk: Now available under CC-By 3.0

Fantastic Wikimania presentation on FastCCI by User:Dschwen, recommended! There are Wikimania London videos on youtube, but they are hard to identify. Does anybody have a direct link to the FastCCI presentation video? That would be cool. --Atlasowa (talk) 15:16, 31 August 2014 (UTC)[reply]

https://www.youtube.com/watch?v=0hcjZvateZs&list=UURXe4cgJPTVHcDH6ZGwOT3A#t=3172 - weiß aber nicht, ob das auf die Hilfe-Seite sollte. Besser eine Commons-Seite starten, denn es ging ja haupts. um den theoretischen Hintergrund und nicht um die Benutzung. -- Rillke(q?) 22:11, 31 August 2014 (UTC)[reply]
@Dschwen: würdest Du einer Veröffentlichung des Videos unter einer freien Lizenz zustimmen? (Dann muss ich nur noch den Recording-Rechteinhaber fragen) :-/ -- Rillke(q?) 22:20, 31 August 2014 (UTC)[reply]
Ja, logo. --Dschwen (talk) 23:54, 31 August 2014 (UTC)[reply]
Danke! Schöne Präsentation, nette Beispiele... :-) Ich habe das youtube-video mal bei der Wikimania2014.wikimedia.org verlinkt. Ob das Video hier auf Help:FastCCI die user überfordert weiss ich nicht, vielleicht klein unter =TechnischerHintergrund= einbauen, dann hat ein technisch Interessierter zumindest die Chance das zu finden.
Dschwen, tausend dank für die Überschrift "and in Videos" bei FastCCI Suche :-) --Atlasowa (talk) 13:30, 2 September 2014 (UTC)[reply]
Bitte sehr. Aber peinlicherweise wird die Ueberschrift eben ganau nicht geaendert, wenn man per link auf ein FastCCI Resultat geleitet wird. Das erfordert noch ein bisschen mehr Arbeit :-). --Dschwen (talk) 20:50, 2 September 2014 (UTC)[reply]

Some bugs ...

[edit]

It seems that the results are based on data that is several weeks old. Images that have been uploaded or (re-)categorized more recently are not found. Is this a bug or is the database update scheduled so rarely? Sometimes I do not even get an empty result, but instead it keeps saying "Connecting...". Also, I have noticed an isolated character sequence "27d" under the results (if some were found). This might be a malformed unicode entity &x27D;, but then again who would want to write "ɽ" there?--Hagman (talk) 17:40, 4 October 2014 (UTC)[reply]

Hello @Hagman: the string 27d is the age of the database. I'm updating it right now. I had to disable automatic updates due to a problem on the server. I'll try to fix this. --Dschwen (talk) 04:17, 5 October 2014 (UTC)[reply]
Oh, so actually my second question was the answer to my first question? I simply failed to interprete the d as days unit. :) --Hagman (talk) 10:10, 5 October 2014 (UTC)[reply]
This would explain why trying to intersect Category:Images from Wiki Loves Monuments 2014 in the United Kingdom and Category:Featured pictures gives three rather than five results. I thought 7d was some obscure hex code. Yes it would be helpful if it the data was more than 24 hours old, if it said "Warning: data is xx days old". I hope you manage to fix the auto update. Can you include a count of results at the top please. Thanks. -- Colin (talk) 16:54, 11 October 2014 (UTC)[reply]

Number of files

[edit]

A very frequent use case is to have the count of files, not the list. Since FastCCI gets the list, it should be able to display the count on top?

Jean-Fred (talk) 16:22, 8 December 2014 (UTC)[reply]

Ha, Jean-Fred. A very good question. But actually it is a bit like the Google search results, FastCCI does not know the exact number, because it does not fetch the entire list! It just fetches enough of the list to display to the user (and it has a well defined ordering to fetch the correct bit of the list). The FastCCI server reports exact counts when it happens to know them (small result sets) and approximate numbers in other cases. I could add exact counting for all results though (at a small CPU time cost). --Dschwen (talk) 17:03, 8 December 2014 (UTC)[reply]

"Good pictures" button onclick event is not showing Thumnails in Firefox

[edit]

See Phabricator. Josve05a (talk) 12:02, 9 April 2015 (UTC)[reply]

@The Photographer: (I hope I got the user right), the fact that the list of image frames is showing up tells me that the Websocket connection was successful. It would be helpful to see what the connections to fetch the thumbnails (those go to the standard commons servers) do. Is this reproducible for anyone? Could it have been a fluke? --Dschwen (talk) 17:07, 9 April 2015 (UTC)[reply]

I dont know what happend, however, simply not working for me --The_Photographer (talk) 12:54, 10 April 2015 (UTC)[reply]
Yeah, we need to get to the bottom of this. Are you on a fast connection? This is stupid, but sometimes the thumbs at the bottom of the page load first, so can you make sure no thumbnails are loading at all? In firefox you should have a context menu on the thumbs with an entry "Inspect element" (you may have to activate the developer tools). Could you check what the html of the thumbnail boxes is? In the Network tab of the firefox dev console you can see all http requests etc. Could you check if you get failed requests for the thumbs, and if so what the error is. And in the Console tab could you look for any error messages as well? --Dschwen (talk) 13:20, 10 April 2015 (UTC)[reply]

Duplicate results

[edit]

FastCCI is showing the same results twice; since two or three wecks ago. I am using Windows Vista and Google Chrome. Thank you--JotaCartas (talk) 22:21, 30 April 2015 (UTC)[reply]

Thanks for reporting this. It is very odd indeed. I will investigate this in the coming days. --Dschwen (talk) 03:54, 3 May 2015 (UTC)[reply]
@JotaCartas: Does it also show a "Still Connecting..." bubble? It just saw that the communication goes not via Websockets anymore but uses a JS callback fallback. Of course the double results are a bug, but one that only manifests now as the Websocket transfer is brokem. I suspect a configuration change on Wikimedia Labs. Will investigate further. --Dschwen (talk) 04:00, 3 May 2015 (UTC)[reply]
Middle of the page
@Dschwen: Yes, It shows the "Still Connecting..." bubble for a few seconds. As exemplified in the the three scans in Category:FastCCI bug, after 199 images, shows "4h", repeats three images, shows "more" and continued repeating until image #199. If I click the button "more" it shows new images and it seems to work perfectly from then on. Also, if I go to the top of the page and click again the "FastCCI" button, everything works OK, showing the images from the beginning and NOT repeating. I hope this will help you.--JotaCartas (talk) 04:47, 3 May 2015 (UTC)[reply]
@Dschwen: At 00:25 2015.05.05 all working OK--JotaCartas (talk) 23:28, 4 May 2015 (UTC)[reply]

19 days without being updated

[edit]

FastCCI database has not been updated since 19 days ago. Does anyone know when the gadget will work normally again? Thanks, --JotaCartas (talk) 00:22, 27 June 2015 (UTC)[reply]

@Dschwen: Can you help me in this matter? --JotaCartas (talk) 17:00, 27 June 2015 (UTC)[reply]
@JotaCartas: I'm working on it. I have problems accessing one of the labs instances and the database server. --Dschwen (talk) 04:14, 30 June 2015 (UTC)[reply]
@Dschwen: Thank you very much, now everything is working perfectly. --JotaCartas (talk) 04:57, 30 June 2015 (UTC)[reply]

Category intersection explanation

[edit]

It would be helpful if there were a way to show how a category intersection was generated. For instance, I just tried to find a flag of Bristol by intersecting Category:Bristol and Category:Flags. The results included the entire contents of Category:Hugo Weaving, and I am unsure why he is categorised under flags! Could there be some mouseover popup, eg for File:Bristol Balloon Fiesta 2009 MMB 38 G-GOGB.jpg you might have:

  • Bristol > Culture of Bristol > Bristol Balloon Fiesta > Bristol Balloon Fiesta 2009
  • Flags > Flags by contenbt > Flags with crosses > Union Flag > Union flag in art > Union Jack on vehicles > Union Jack on aircraft

-mattbuck (Talk) 12:22, 14 July 2015 (UTC)[reply]

Yes, this is a good idea. It should not be too hard, as I already have the breadcrumbs code in place. --Dschwen (talk) 15:28, 15 July 2015 (UTC)[reply]
@Mattbuck: I added a quick hack to show multiple breadcrumb trails on the image page. I believe Jean-Frédéric (talk · contribs) asked for that a while ago as well. --Dschwen (talk) 16:08, 15 July 2015 (UTC)[reply]
I'm not seeing anything currently, perhaps this is due to running an older version of Firefox at work - I'll have a test at home later. -mattbuck (Talk) 09:01, 16 July 2015 (UTC)[reply]
Works fine for me. Thanks for adding this, Dschwen, very interestig information … [1] --El Grafo (talk) 09:24, 16 July 2015 (UTC)[reply]
On Category:Bristol, In this category and in ..., Flags, Ok, click a FastCCI thumbnail, on top of the file description page, the paths through category tree are listed as breadcrumb navigation trails. -- Rillke(q?) 09:27, 16 July 2015 (UTC)[reply]

FastCCI and Cat-a-lot

[edit]

Hello, is it possible to use the tool Cat-a-lot on the results found by FastCCI? if no it would be great it's possible one day! --Christian Ferrer (talk) 09:05, 23 August 2015 (UTC)[reply]

additional rankings

[edit]

what about adding rankings for

1. most to least "in use"

2. most viewed

?

Lx 121 (talk) 17:47, 23 August 2015 (UTC)[reply]

Limit the recursion level

[edit]

Is there a way to limit recursion level? Sometimes I would like to intersect 2 categories with no recursion or one level of recursion. --Jarekt (talk) 15:37, 5 November 2015 (UTC)[reply]

Is there a slider? For me, over mobile connection, it does weird things currently so I can't see it myself. -- Rillke(q?) 16:06, 6 November 2015 (UTC)[reply]
No slider, just infinitely deep (I think) recursion, resulting in often surprising results. --Jarekt (talk) 16:11, 6 November 2015 (UTC)[reply]

In this category and in...

[edit]

Hello, in a specific category, would there a way to have a list of all categories (not the parents categories) whose images are tagged? Regards, --Christian Ferrer (talk) 09:18, 15 November 2015 (UTC)[reply]

Good Pictures Icon not working

[edit]

The "Good Pictures" icon on the "Category" pages does not appear to be working. My computer goes into a "Connecting" loop and waits. The same happens on my wife's laptop. I posted this question on Commons Help and User:LX saw the same problem. When I followed the drop-down list on the "Good Pictures" icon, I came to this page, so I checked the "FastCCI server status" and got a 502 Error (bad gateway).

Is this a Wikimewdia problem or my problem?

At the suggestion of User:LX, I am pinging @Dschwen: Martinvl (talk) 20:50, 16 February 2016 (UTC)[reply]

Looks like the server is down. According to wikitech:Nova Resource:Fastcci, @Dschwen: is the only maintainer, besides the Wikitech/WMFLabs infrastructure maintainers. -- Rillke(q?) 23:50, 16 February 2016 (UTC)[reply]
@Dschwen: maybe it would be a good idea to somehow output an error message. The following is visible in the browser's console: WebSocket connection to 'wss://fastcci.wmflabs.org/?c1=2718119&d1=15&s=200&a=fqv' failed: Error during WebSocket handshake: Unexpected response code: 502. -- Rillke(q?) 23:52, 16 February 2016 (UTC)[reply]

Searching tool

[edit]

Hi, FastCCI allow more that to show only good images, as per as it is highlighted in this comment, I think the text "good pictures" should be changed to something like "Searching tool". Christian Ferrer (talk) 18:39, 25 November 2016 (UTC)[reply]

Yes, it's still not obvious to our users what features hide behind that button. And those who are bothered by certain category trees with lots of subcategories and few images that, they believe, can only be seen after too many clicks, never find out that there's an easy way to display all images at once. Please, please finally change something to make this more user friendly. Instead of "good pictures", the button could be labeled "Search tool", "More options", in German: "Erweiterte Auswahl" --Sitacuisses (talk) 15:07, 8 April 2018 (UTC)[reply]

Publicize the all images feature better

[edit]

I just found out about the "all images" feature at the 2016 Community Wishlist Survey/Categories/Multimedia [2] where it was it was pointed out that the feature provides a requested capability. While I appreciate the effort to make evaluated images easier to find, I think the all images feature might be even more useful to most editors. It should be easier to discover. One suggestion might be to change the label from "Good images" to " Find images", adding Good to the dropdown list, of course. Another simple improvement would be including an icon for All images. Here are two possibilities (the latter should be redrawn to be bolder): --agr (talk) 23:23, 27 November 2016 (UTC)[reply]

This is a different approach to the same issue that Christian Ferrer adressed in the previous section. Still this seems to be ignored? --Sitacuisses (talk) 15:13, 8 April 2018 (UTC)[reply]

Is FastCCI down?

[edit]

The tool hasn't been working for me for the past couple weeks... has it been down? Ed [talk] [majestic titan] 10:01, 15 January 2017 (UTC)[reply]

Ping Dschwen. :-) Ed [talk] [majestic titan] 01:35, 18 January 2017 (UTC)[reply]
Its working for me. Just checked now. Jee 03:44, 18 January 2017 (UTC)[reply]
It's still not working for me. It gets stuck while looking through the files or, like right now, on "computing..." Ed [talk] [majestic titan] 00:00, 26 January 2017 (UTC)[reply]
Got now. It stuck in big categories like Category:Computing. Showing "Digging through 37490997 files..." I don't know Dschwen is active now. Pinging Rillke too. Jee 02:51, 26 January 2017 (UTC)[reply]
Thanks for the help, Jkadavoor! Ed [talk] [majestic titan] 05:44, 28 January 2017 (UTC)[reply]
@Dschwen and Rillke: This tool is still getting stuck for me in medium and large categories on an occasional basis. Is there any chance of getting a fix, if there is one to be had? Thanks very much! Ed [talk] [majestic titan] 01:01, 17 March 2017 (UTC)[reply]
Looking into it. --Dschwen (talk) 20:53, 17 March 2017 (UTC)[reply]
Oh, yikes, it segfaults on the server. --Dschwen (talk) 20:56, 17 March 2017 (UTC)[reply]
I'm trying to get some access issues sorted out. Then I'll start the server in a debugger. I should be able to fix this. --Dschwen (talk) 21:38, 17 March 2017 (UTC)[reply]
This might take a while. I hope I can sort it out over the weekend. The segfault is in the websocket library. I need to debug this locally. --Dschwen (talk) 02:24, 18 March 2017 (UTC)[reply]
I have disabled WebSockets support for now. It looks like that is what's broken on the server. For now the gadget should work again. I'll continue working on it in the meantime. --Dschwen (talk) 02:49, 18 March 2017 (UTC)[reply]
✓ Done. I re-enabled websockets support. I think I fixed the crash bug (although I'm not entirely sure why it appeared in the first place)> Please let me know if any issues persist! --Dschwen (talk) 00:03, 19 March 2017 (UTC)[reply]
@Dschwen: It works! Thank you so much. This is a great tool, one that I use more days than not. Ed [talk] [majestic titan] 15:39, 21 March 2017 (UTC)[reply]
Hey @Dschwen: , I've been running into problems again recently with the tool getting stuck in the "Connecting..." phase—and when it does work, I'm stuck waiting in line for others. Any thoughts? Thank you again! Ed [talk] [majestic titan] 20:16, 27 July 2017 (UTC)[reply]
Yeah, I'm getting emails from the uptime service that checks FastCCI. I'll work on this in the next few days. There is redundancy in teh backend, so if it doesn't work you should be able to try again. I'll make that thing smarter, so that it automatically tries the next server if one is down. --Dschwen (talk) 03:23, 28 July 2017 (UTC)[reply]
@Dschwen: It looks like the tool is down again. :-( Ed [talk] [majestic titan] 15:57, 15 September 2017 (UTC)[reply]
I think I spoke too soon. It's working for me right now. Ed [talk] [majestic titan] 16:48, 19 September 2017 (UTC)[reply]

For the past several months I find that it has a ~25% of working at any given point. Usually, it hangs on "Connecting...". Leaving it alone to "connect" for a long period of time doesn't seem to help (i.e. either it loads quickly or doesn't load at all). Once in a while, reloading will help, I think, but usually I try it several times (usually on more than one category just to make sure that's not a factor) and give up. Size of the category doesn't seem to matter. The up/down reported in this thread makes me think that either my impression is due to the tool being regularly unavailable to all, or that other people are having the same individual issues I am... — Rhododendrites talk22:33, 28 November 2017 (UTC)[reply]

Ping Dschwen? I've found ways around this over the last month or so when it times out "(Connecting..."), but it'd be really cool if there's an easy fix for this. :-) Ed [talk] [majestic titan] 14:57, 8 January 2018 (UTC)[reply]

I've also been having trouble getting it to work. I usually get an endless "Connecting..." and sometimes something like "Waiting in line. 6 ahead of us." Only very rarely do I see the number of files being sorted, and most rarely does the gallery of good pictures pop up. Same issue on both Chrome and Firefox, FWIW. Just now I tried searching Category:Falconidae, it worked! and then I tried again and got "Connecting". Animalparty (talk) 07:22, 8 February 2018 (UTC)[reply]

Same with me, I still can't use FastCCI, it always responde as "connecting..." and loading forever. Hope people can fix soon, this is one of Commons' great tools. --minhhuy (talk) 08:13, 22 February 2018 (UTC)[reply]
down today? --Atamari (talk) 17:48, 7 April 2018 (UTC)[reply]
Try to reload. There is a ticket on GitHub. I need to work on it. --Dschwen (talk) 19:10, 7 April 2018 (UTC)[reply]
Yeah, it's been periodically up and down for me over the last few months as well, including today. :-( Ed [talk] [majestic titan] 15:52, 18 April 2018 (UTC)[reply]
@Dschwen: Have you made any progress on this? We haven't heard from you in over a month, are you ok?   — Jeff G. ツ please ping or talk to me 07:04, 24 May 2018 (UTC)[reply]
@Jeff G.: et al, maybe we should temporary disable this function in the interface until fixed? --Steinsplitter (talk) 15:25, 27 May 2018 (UTC)[reply]
@Steinsplitter: That makes good sense. Is there anyone available with the expertise and access to fix it?   — Jeff G. ツ please ping or talk to me 22:25, 27 May 2018 (UTC)[reply]

fastcci1.wmflabs.org/status says "502 Bad Gateway"

[edit]

Just wanted to mention that https://fastcci1.wmflabs.org/status returns "502 Bad Gateway"

Also, clicking "Good pictures" on a Commons category page makes "Connecting..." appear and then it stays like this, seemingly forever. Pressing F12 in Firefox reveals that wss://fastcci2.wmflabs.org/?c1=63023201&d1=15&s=200&a=fqv also ends up in a 502 error.

Thanks :-) Syced (talk) 09:44, 8 May 2018 (UTC)[reply]

https://github.com/Commonists/fastcci/issues is the place to report issues with this gadget.   — Jeff G. ツ please ping or talk to me 17:10, 23 May 2018 (UTC)[reply]

T:12, is it "to insert category", not intersect?

[edit]

At T:12, it says: "The advanced interface is accessible through the dropdown menu activated by the right part of the button. Through this menu operations like arbitrary category intersections can be performed. "
For the second sentence, do you mean:

  • current sentence: Through this menu operations like arbitrary category intersections can be performed.
  • suggested edit: Through this menu, you can perform operations such as to insert category arbitrarily.

My question is to clarify as I am translating this page. --Omotecho (talk) 12:43, 29 November 2018 (UTC)[reply]

@Omotecho: Thank you for translating the page! The sentence does inded mean intersection − ie, finding all images that are both in Category:A and Category:B. Jean-Fred (talk) 21:21, 29 November 2018 (UTC)[reply]
@Jean-Fred: , appreciate your prompt reply, and I see, we are talking about sorting images that are under two categories, or intersection. Yes, a Math vocaburary. :) Issue solved for me, thank you so much and going back to translation. Cheers, --Omotecho (talk) 17:12, 30 November 2018 (UTC)[reply]

T:20 Please mark for translation

[edit]

I tried to mark for translation by adding tvar tags, but it seems not to work. Under ”External links”, the third dagger needs to be marked for translation, which reads:

  • FastCCI - Taming the Commons Category Tree Dschwen, Wikimania 2014 presentation (PDF-slides, video on YouTube)

--Omotecho (talk) 17:26, 30 November 2018 (UTC)[reply]

Down again?

[edit]

Hey @Dschwen: , the tool isn't progressing past "Connecting..." for me. :-/ Ed [talk] [majestic titan] 17:51, 7 March 2019 (UTC)[reply]

Same here. Stuck on "Connecting". It hasn't worked for weeks as far as I can see. Why is this? Cnbrb (talk) 15:27, 10 April 2019 (UTC)[reply]
@The ed17 and Cnbrb: I was able to duplicate the problem and I reported it at https://github.com/Commonists/fastcci/issues/8.   — Jeff G. please ping or talk to me 15:43, 10 April 2019 (UTC)[reply]
Doesn't seem like it's worked in quite some time for me. Dschwen doesn't seem to be around Commons much over the past year and a half. Maybe a good candidate for the Community Wishlist next time? — Rhododendrites talk21:11, 11 April 2019 (UTC)[reply]
Same. FWIW, this is the kind of error I get in the console when I click on 'Good pictures' or one of the other dropdown links: [Report Only] Refused to connect to 'https://fastcci1.wmflabs.org/?c1=64207500&d1=15&s=200&a=fqv' because it violates the following Content Security Policy directive: "default-src 'self' data: blob: https://upload.wikimedia.org meta.wikimedia.org *.wikimedia.org *.wikipedia.org *.wikinews.org *.wiktionary.org *.wikibooks.org *.wikiversity.org *.wikisource.org wikisource.org *.wikiquote.org *.wikidata.org *.wikivoyage.org *.mediawiki.org wikimedia.org". Note that 'connect-src' was not explicitly set, so 'default-src' is used as a fallback. Colin M (talk) 20:53, 18 April 2019 (UTC)[reply]
Since there is no answer on github, is there anywhere to ask for a solution? This tool is very useful, and being stuck with "Connecting..." is infuriating. Gyrostat (talk) 10:37, 5 June 2019 (UTC)[reply]
[edit]

According to the presentation, the tool should generate a breadcrumb trail that tells you why a certain image was included in a certain category, which I think would be helpful; however, I'm not getting such a breadcrumb trail. Has it been removed? Or does it need to be activated in some way? —Kri (talk) 18:34, 28 July 2019 (UTC)[reply]

Enhancement - only images from Wikidata

[edit]

It would be great to create an option to only get the images that are in wikidata (usually the best/most representative of each category). Also requested in Commons:Village pump/Proposals#FastCCI - Enhancement - Only images from Wikidata --JotaCartas (talk) 00:28, 31 January 2020 (UTC)[reply]

18 days without an update

[edit]

What is going on? 18 days have passed without an update. Can anyone elucidate us about this?--JotaCartas (talk) 06:57, 15 March 2020 (UTC)[reply]

Today, 49 days have passed and there are no solutions or any information 😞😞😞--JotaCartas (talk) 16:31, 8 April 2020 (UTC)[reply]
113 days have passed and there are no solutions or any information --JotaCartas (talk) 06:22, 18 June 2020 (UTC)[reply]
Thats sad. @Dschwen: --Andrei (talk) 19:35, 25 June 2020 (UTC)[reply]
@Dschwen: @Andrew J.Kurbiko: Eureka, after 8 months, started to work 🤗🤗🤗. I hope it is not a premature baby, with difficulties of survival🤔🤔🤔 --JotaCartas (talk) 07:02, 30 October 2020 (UTC)[reply]

Yeah, sorry about the absence. It would be useful to have a second maintainer on that project so it does not stand or fall with me alone... --Dschwen (talk) 23:42, 4 January 2021 (UTC)[reply]

Dschwen, what sort of things are you looking for? Are the current issues just something that requires periodic service restarts? I'm sure there are plenty of people willing to assist with maintaining that sort of thing (myself included!). Perryprog (talk) 23:37, 25 October 2021 (UTC)[reply]

And now today

[edit]

Today it worked for me, but only sort of. It returns an incomplete list. Doesn't matter if it's a large category (e.g. Category:Green-Wood Cemetery, which returns maybe 20 good pictures out of, well, more than that) or a small one like Category:Birds in Green-Wood Cemetery which only finds 3 of the QIs (and an FP) in the group. — Rhododendrites talk15:11, 27 June 2020 (UTC)[reply]

Not working with titles longer than +-50 characteres

[edit]
FastCCI bug

FastCCI does not work when the category title is longer than (+-50) characters. Ex. Category:Capela de Nossa Senhora da Conceição (Foz do Douro) --JotaCartas (talk) 01:13, 31 October 2020 (UTC)[reply]

OK, it works if you zoom out your browser. --JotaCartas (talk) 01:29, 31 October 2020 (UTC)[reply]

It does not work

[edit]

As of 2020-12-11, this does not work – shows only “connecting”. --Nefronus (talk) 19:35, 11 December 2020 (UTC)[reply]

It seems that the backend server is down. --Nefronus (talk) 16:12, 14 December 2020 (UTC)[reply]

I concur: "502 Bad Gateway" --Iketsi (talk) 01:53, 15 December 2020 (UTC)[reply]
The same happens here, since some days ago. I hope it does not last as long as eight months as the time before --JotaCartas (talk) 07:45, 16 December 2020 (UTC)[reply]
This is also broken for me. Can someone report this to the developers so it can be fixed promptly? 68.14.140.7 23:31, 18 December 2020 (UTC)[reply]
It is working again --JotaCartas (talk) 22:41, 4 January 2021 (UTC)[reply]
yeah, I fixed it today! --Dschwen (talk) 23:41, 4 January 2021 (UTC)[reply]
Resolved
, Dschwen, thank you --JotaCartas (talk) 05:31, 5 January 2021 (UTC)[reply]

Relevant: a community wishlist request involving FastCCIRhododendrites talk02:02, 15 December 2020 (UTC)[reply]

Same problem again? Doesn't do anything. Bag Gateway in console. -- Discostu (talk) 23:03, 17 September 2021 (UTC)[reply]

I have same problem at the moment. It is writing “connecting” for few days --Butko (talk) 06:45, 23 September 2021 (UTC)[reply]

Mobile support

[edit]

For some reason on mobile (touch screen) devices the gadget does not work anymore. It is impossible to press the button. I know this wasn't always so and I'll be working on this. Also, this needs to be updated to use OOUI.js. I'll work on that. --Dschwen (talk) 02:38, 19 January 2021 (UTC)[reply]

Down again, again?

[edit]

Is this gadget down again? I'd like to use it to find a good/featured photo from Category:Musicians from the United States for use at w:United States#Music, but it only says "connecting..." I've encountered that other times recently, too. {{u|Sdkb}}talk 05:24, 27 September 2021 (UTC)[reply]

Sdkb, I've had it connect fine, but the category breakdown view you get once you click on a photo has been missing in action for me. Example image has a console error that says [Error] WebSocket connection to 'wss://fastcci1.wmflabs.org/?c1=NaN&c2=86209375&a=path' failed: Unexpected response code: 500. This happens on both Safari 15.0 and Firefox 92.0.1; CC Dschwen. Perryprog (talk) 20:20, 9 October 2021 (UTC)[reply]
Sdkb Perryprog Having the same problem as Sdkb. I used it up into September but now stalls indefinitely on "Connecting..." Using Firefox 93.0 (also tested with Google Chrome Version 94.0.4606.81) on Ubuntu 20.04.3 LTS. It loads ~60% of the time on Firefox mobile (android) but a few presses of 'refresh' eventually fix that. --Ohlookitsthebard (talk) 14:05, 19 October 2021 (UTC)[reply]
It's been down for a while for me too, just says "Connecting..." and nothing happens. I'm on Fiefox 93.0 on Linux Mint 20.2. Developer console shows GETwss://fastcci2.wmflabs.org/?c1=4689266&d1=15&s=200&a=fqv [HTTP/1.1 502 Bad Gateway 32906ms]
Firefox can’t establish a connection to the server at wss://fastcci2.wmflabs.org/?c1=4689266&d1=15&s=200&a=fqv. load.php:102:685 -- Veikk0.ma (talk) 12:02, 22 October 2021 (UTC)[reply]
It's up! Glad to have it back. --Ohlookitsthebard (talk) 15:12, 3 November 2021 (UTC)[reply]

Hello, I still have the problem. It just says "Connecting", FF and Chrome alike. Ziko (talk) 21:06, 12 November 2021 (UTC)[reply]

Yeah it's down again for me too (mobile or desktop, FF). I hope it comes back again soon, really invaluable tool. --Ohlookitsthebard (talk) 15:06, 21 November 2021 (UTC)[reply]

It's back! FireFox mobile. first time since going down sometime in October/November --Ohlookitsthebard (talk) 00:01, 2 December 2021 (UTC)[reply]

Reason it's always down?

[edit]

@Dschwen: I get that you don't have time to maintain this tool, which is unfortunately extremely important/useful and quite unreliable, but perhaps you could write a bit about what the challenge is on the back-end that causes it to go down so often. That way anyone who might be interested to maintain it (or write an alternative) could be prepared? Thanks. — Rhododendrites talk14:53, 14 November 2021 (UTC)[reply]

Hello, at the moment the tools works (again) for me. As it is indeed very important, it would be great if someone of the WMF could help to prevent malfunctioning in the future. Kind regards, Ziko (talk) 16:15, 20 December 2021 (UTC)[reply]
It’s down again… --Nefronus 18:17, 26 December 2021 (UTC)[reply]
Had a brief window of functioning FastCCI (in 2022) but it's down again. --Ohlookitsthebard (talk) 14:49, 11 January 2022 (UTC)[reply]

Should be back up. The challenges are that we're dealing with a large graph that needs to be queried with extremely high performance. The code is on github. The status is available here: https://fastcci1.wmflabs.org/status and here: https://fastcci2.wmflabs.org/status . I'll have to think about improving scalability to keep up with teh ever growing commons category graph. --Dschwen (talk) 21:50, 11 January 2022 (UTC)[reply]

Ok, I think I have a more scalable, future proof way of building the database through the use of mmap and mremap rather than malloc and realloc. That way I'm not bound by RAM size. I'll work on having the serves use mmap as well once I determine what the performance impact is. --Dschwen (talk) 01:03, 12 January 2022 (UTC)[reply]

@Dschwen: It appears to be down again. See https://commons.wikimedia.org/wiki/Commons:Village_pump#Good_pictures_button_broken_again Mateusz Konieczny (talk) 13:28, 15 August 2022 (UTC)[reply]

Upgrading to Debian 11

[edit]

I'm working on upgrading (rebuilding) all VMs from Debian 9.5 to 11. That should be good for a few years (support until 2026). There might be some service interruptions. But it's looking good so far. --Dschwen (talk) 21:58, 16 January 2022 (UTC)[reply]

Bugs

[edit]

Hi, I have noticed some problems with the gadget FastCCI enabled by default, CC @Dschwen:

  • the font size is larger than the rest of the text on the page (Vector 2022)
  • the icons of FP/QI/VI overlap (Legacy Vector and Vector 2022)
  • when you click on the "Good pictures" button, the words "Good pictures" appear in the title, between "Category:" and the category name (Legacy Vector and Vector 2022)
  • by adding ?safemode=1 to the url, the problem disappears.

Patafisik (WMF) (talk) 08:55, 17 September 2022 (UTC)[reply]

Hi, there is an other gadget on fr.wiki which was not working correctly, because of phab:T313947 and this change (here the original discussion). To summarize: "elements of the .vector-page-titlebar were reorganized and passed from display flex to display float", a solution was found, '"the gadget should either be inserted after the title of the page rather than before, or simply add the order: 1; style". Patafisik (WMF) (talk) 16:32, 20 September 2022 (UTC)[reply]
Thanks. I have however once again lost the ability to edit my own gadgets... So if anyone wants to make that change fro me that'd be great. --Dschwen (talk) 00:44, 4 December 2022 (UTC)[reply]

Language bug?

[edit]

With french language on commons, I cannot see the gadget on:

But I can see it on:

Gonioul (talk) 22:21, 11 November 2020 (UTC)[reply]

Useless tool...

[edit]

This tool is very necessary, for example, to see all the images in a subcategorized category. However, FastCCI is neither fast nor useful. Every time you click on the tool, the message "establishing connection" appears and it gets stuck. Never in my 10 years of work at Commons has it worked for me only 1 time. So I propose to remove this tool or change it. --– El Mono 🐒 (talk - es.wiki) 14:47, 15 November 2021 (UTC)[reply]

I don't agree with "useless tool" but I agree it seems completely broken to me at the moment (and, I agree that I was never able to see this working in my life). Unfortunately I do not know how to help, if a developer is needed. --bozz (talk) 14:00, 13 October 2023 (UTC)[reply]
I reported this technical issue in the Wikitech talk page: wikitech:Nova Resource Talk:Fastcci#Offline? bozz (talk) 14:10, 13 October 2023 (UTC)[reply]

Limit number of files to dig thru

[edit]

sometimes it shows me "digging thru 80121212 files...", because, i guess, some cats somehow contain the entire commons cat tree and cause fastcci go thru EVERYTHING on commons.

i suggest stopping fastcci at 10 million files, or finding at least 1 file, whichever is later.--RZuo (talk) 19:54, 8 February 2023 (UTC)[reply]

Date ranges

[edit]

How about adding an option to search by date ranges?--agr (talk) 19:57, 16 July 2023 (UTC)[reply]

Large Images

[edit]

When trying to search for files that are located both in a category and Category:Large images, around half of the thumbnails in a result don't load. If someone could improve the capability on this front, it would be very helpful. StellarHalo (talk) 03:42, 1 August 2023 (UTC)[reply]

Not loading, showing offoptic images, and proposal for a forked gadget that shows the cat-path why a file is in cat

[edit]

Thanks for this great tool (@Dschwen: ), it has lots of potential. However, it seems to have two or more major issues so it's usually not that useful/usable:

  1. most of the time it just loads with "Connecting..." – issue here: phab:T367652
  2. it display lots of offtopic images somewhere deep down in a category branch – proposed solution: certain subcat types should be filtered out/filterable such as "xyz in art" subcats (e.g. "Maps of the world in art" underneath Maps of the world") and there could be a lower default subcategory-depth level so that it only goes through the highest 5 subcategories (the latter would be a temporary fix or one could make it so that one could load more images deeper down on request/when scrolling [infinite scrolling])

I'm mostly interested in this because it's relevant to this well-supported technical proposal for a wall of images view for category pages (e.g. maybe parts of the code could be repurposed for that which could make WMC actually interesting to explore for users, enable a modern engaging UI, and be more useful).

If you got another idea about the two issues above please let me know, I meant to ask about sth else:


FastCCI Commons gadget showing why a quality image is erroneously categorized into a category; a separate gadget that does this for any file is needed

The gadget already has a feature that shows why a specific image is located somewhere underneath a specific category (the category where the Quality images button was clicked) as shown in the screenshot.

I'm looking for a way where one can check why any specific image is anywhere underneath a specific category, see the village pump discussion How to find the source cat for why a given image is in a specific category tree?.

This is useful for example when images that shouldn't be there show up in a petscan and because FastCCI only works for quality images etc and not any kind of file.

Could you create a new tool that allows for that? (Directed at Dschwen as well as anybody else interested). Maybe it wouldn't require lots of changes to the code that already does that for quality images. That gadget could show an extra search box on a category page where one could enter the file's url or name and/or it could be a separate toolforge site where one enters it to view the shortest or all routes by which a file is located underneath a specific category. Prototyperspective (talk) 14:20, 19 June 2024 (UTC)[reply]

For example, I'd like to know why this scan shows so many image files as being in the Videos cat; why this scan shows files that are not science fiction films; why this scan shows several files that are not comedy like this or this ... Prototyperspective (talk) 21:39, 20 August 2024 (UTC)[reply]
Also see https://github.com/magnusmanske/petscan_rs/issues/182 "A way to see why files are included in the specified cats (source of categorization)" for Petscan. Prototyperspective (talk) 10:25, 26 October 2024 (UTC)[reply]