#holosdiscover

I am at a stage with #HolosDiscover where I wonder if I should make it a separate project with its own server, or just clean up the DB from old messages. Of course, all messages are removed or updated as soon as the OP makes the action, but keeping such an amount of data impacts the infra I run alone for all my services. I have no way to track how it is used, so your feedback matters. What's your opinion?

#HolosDiscover now lets you filter trends (posts, tags and links) by language. It also displays trending accounts related to those results. What's your opinion about bringing HolosDiscover inside #Fedilab?

With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub. Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks. We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

Contrary to what some people say, #HolosDiscover is not a scraper. It speaks #ActivityPub, and every deleted or edited post is immediately updated in the database. It relies on the #Fediverse indexable flag, with stricter rules: accounts with #NoBot or #NoIndex in their profile, and locked accounts, are excluded. Only public posts are indexed. I recently fixed a bug where the #NoIndex tag in bios was not respected. Sorry about that. https://discover.holos.social/

I fixed a privacy bug in #HolosDiscover. If you asked not to appear in search through your bio, it did not always respect that because the #NoIndex tag in bios had a bug and the bot did not read profile fields. In some cases discovery also fell back to the discoverable flag, which is now removed (that flag is about accounts, not posts). Everything is fixed and I also cleaned up what was already stored. The database is clean. Sorry for that.

@stefano@mastodon.bsd.cafe - for #LittleFedi have you thought about using the same technique or even the say relays as #HolosSocial and #HolosDiscover to have the micro single users server speak to and see the larger Fediverse better?

I will investigate the issue with #HolosDiscover. Since another bot was launched on holm.community, I have been getting several complaints:

• NoIndex/nobot in bio not respected
• Locked accounts followed
• AP flag not honored

I contacted the maintainer to ask whether the code was changed. This should never happen. These complaints only started after that bot appeared.

I am taking this very seriously. If the problem is in my code, I will fix it immediately. Sorry about that.

@atomicpoet@atomicpoet.org Am a huge fan of #holosdiscover and actually the entire #holossocial project.

#HolosDiscover has an issue with accents that I'll fix ASAP. For instance, searching for "Androïd" returns far fewer results than "Android". In case you can't see the difference, the letter "i" has a diaeresis (tréma) in the first word.

RE: https://toot.fedilab.app/@apps/116970784475112417 #HolosDiscover is a kind of search engine for the #Fediverse, fully working with #ActivityPub. That means it doesn't scrape content, it receives it organically. As soon as a post is deleted, it's removed from the index. The same goes for edits. If an account opts out, everything is removed from the index. It only indexes public posts from followed accounts that have the indexable flag turned on (locked accounts are excluded). More: https://discover.holos.social

#HolosDiscover is a search engine dedicated to the #Fediverse. It does not scrape content, because it speaks #ActivityPub and respects each user's choice to opt in or out. The most respectful alternative, open to all and full of content to explore. https://discover.holos.social

#HolosDiscover now displays #PeerTube videos correctly in search results. https://discover.holos.social/

RE: https://toot.fedilab.app/@apps/116777926060900347 #HolosDiscover continues to evolve into the privacy respecting search engine the #Fediverse has needed for some while now....

#HolosDiscover now indexes #PeerTube videos. You can find them in search and timelines, but the way they look still needs some work. A video is not the same kind of #ActivityPub object as a normal post. A post is a short text made to be read in the timeline. A video has a title, a long description, and a media file, so it should be shown as a video card with a thumbnail and a link, not as plain text. That part is coming next.

RE: https://toot.fedilab.app/@apps/116722285369696704 The most common answer is people asking what #HolosDiscover is. It's a service that indexes messages across the #Fediverse and lets you search through the data. What makes HolosDiscover unique is that it's not a scraper. It has an account, several opt-outs that automatically remove data, and most importantly indexed messages are immediately removed or updated as soon as the owner makes a change. Have a look at https://discover.holos.social

#HolosDiscover 1.7.4 is available. This release fixes an issue where common words returned very few results when sorting by relevance, and it improves search quality for those words. It also makes searches faster for both rare and frequent terms. https://discover.holos.social/

Concerning #Fedilab, with close to 8 million messages indexed, I think #HolosDiscover now has enough content to be worth integrating. Full API support would allow pinning tailored timelines and interacting with new content. This would be particularly useful for small instances. More about HolosDiscover: https://discover.holos.social/how-it-works If you're a dev: https://discover.holos.social/api-docs

Holos Discover added a couple of new filters to its API search - minimum likes and minimum boosts. Additionally, you can pass contentType=image|video|audio|text|all|none to the /api/search endpoint and it works.

Interesting combinations, which I took advantage of for the Open Web Image Gallery.

https://gallery.box464.social/?adapter=holos&instance=discover.holos.social&tag=bloomscrolling&minRepostsCount=10

#FediDev #OpenWeb #HolosDiscover

@apps@toot.fedilab.app Can you describe to me more about your planned support in #HolosDiscover, and what you have already done to support this in #FediLab?

#HolosDiscover now allows filtering results by multiple languages (for instance French + English). You can create timelines with up to 20 hashtags. You might be surprised to discover small accounts sharing hobbies you enjoy. The #HolosSocial app already uses it. If you are an app developer, don't hesitate to use the API: https://discover.holos.social/api-docs