[ home / board list / faq / random / create / bans / search / manage / irc ] [ ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Catalog

Name
Email
Subject
Comment *
File
* = required field[▶ Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Options
Password (For file and post deletion.)

Allowed file types:jpg, jpeg, gif, png, webm, mp4, swf, pdf
Max filesize is 8 MB.
Max image dimensions are 10000 x 10000.
You may upload 5 per post.

New user? Start here ---> http://hydrusnetwork.github.io/hydrus/

Currently prioritising: simple IPFS plugin

YouTube embed. Click thumbnail to play.

 No.2173

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v195/Hydrus.Network.195.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v195/Hydrus.Network.195.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v195/Hydrus.Network.195.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v195/Hydrus.Network.195.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v195/Hydrus.Network.195.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v195.tar.gz

I had a good week. I worked on several different things and did a bit more IPFS stuff. An important bug fix means all clients will have to do a bit of reprocessing.

ipfs stuff

I've written up some basic IPFS help here:

https://hydrusnetwork.github.io/hydrus/help/getting_started_ipfs.html

So if you have been holding back, check that out and have a play with it.

I've also added IPFS services to 'system:file service', so you can now find all your pinned files again, and I've added an option to the manage services dialog to make copying multihashes more flexible.

repository processing bug

I discovered an important bug in repository processing that meant some content was not being processed in certain situations. I have fixed the bug, and I've retroactively semi-reset repository processing. Your repositories will go over all their updates again and reprocess, picking up anything that was missed.

Even though the clients are going back to the start, it won't take too long to catch back, as reprocessing content that is already in the db works about 10-20 times faster than regular processing (my laptop is working at 8,000 rows/s, my dev machine at 20,000 rows/s). Just let your clients keep syncing like normal, and you should be caught up again within the week.

8chan thread watcher

I fixed a bug that was sometimes missing OP images in the 8chan thread watcher, but I've since discovered a new problem–lots of boards have started to host their images and thumbnails off media.8ch.net rather than 8ch.net (including now /hydrus/). I presume this is related to the various dev work and migrations and so on of the recent months being sorted out, but unfortunately the JSON API doesn't specify which domain I should be using, or at least I can't find where it so says.

I don't follow 8chan news very closely, so have I missed some tweet about a migration to media.8ch.net for content hosting? Is there a master board list somewhere of which boards are using which domain that I can just hardcode for now? Is there a 'board API' that'll give a bit of JSON describing the board? Something like this:

https://8ch.net/settings.php?board=k

If there is an easy answer to this that I have missed, let me know, otherwise I'll go officially ask someone. I guess /operate/ would be the right place?

If there isn't an easy answer, then I'll probably write an extra step into the watcher that fetches the html version of the page and inspects the links manually to figure out the domain, and cache that info for the rest of the session.

Anyway, for now I am keeping the thread watcher pointed at 8ch.net. /pol/ and /v/ and a handful of others work, but /s/ and and /k/ don't, for instance.

all known files and tags

In preparation for the new cache layer, I have disabled searches over 'all known files' cross-referenced with 'all known tags'. This search domain is so massive, computationally heavy, and so very rarely used, that it is ultimately best to just not support it going forward. If you want to search absolutely everything your client knows about, open up several 'all known files'/'specific tag service' searches in parallel.

full list

- wrote up a v1.0 ipfs help page

- added ipfs services to 'system:file service'

- added a 'multihash prefix' option to ipfs services in 'services->manage services'–it will prefix thu given text to multihashes copied to the clipboard (e.g. you could use 'http://127.0.0.1:8080/ipfs/')

- fixed a bad repo sync processing bug that was incorrectly assuming packages were completely processed when they often were not

- all repos will have their processing timestamps reset on update, forcing a (fast) reprocess of everything they have to cover the previously missed content

- fixed 8chan OP image parsing, which was sometimes failing due to absent md5s in the json

- widened the splash screen a little more so repo sync text can fit a bit better

- a couple of splash status texts are shuffled around

- updated to sqlite 3.11.0 for windows

- if sqlite3 reports at least version 3.11.0, the db will stick to WAL for large transactions (lke vacuum and content processing), since these are fast now

- 'namespace:*anything*' will now only appear if the a/c input has no 'subtag' component., e.g. 'character:'

- import and export folders now print simple summaries to the log if they do some work

- tidied up the 'pages' menu

- the various hardcoded 'delete' key events are now also triggered by a backspace on os x

- added a rough 'copy known urls' to the regular thumbnail menu. this is prototype, let me know how you would like this information managed and displayed in future

- in prep for the new cache layer, the autocomplete dropdowns (and hence search domains of all contexts) no longer support 'all known files' cross referenced with 'all known tags'

- misc cleanup

next week

I'll move both IPFS directory sharing and my new cache layer forward.

 No.2177

I hope this issue is not covered somewhere and I just didn't look good enough for a solution.

Since the last update I'm getting for all my tumblr subscriptions the following error.

> ValueError

> Expecting object: line 1 column 120911 (char 120910)

> Traceback (most recent call last):

> File "include\ClientImporting.py", line 2341, in Sync

> self._SyncQuery( job_key )

> File "include\ClientImporting.py", line 2192, in _SyncQuery

> ( page_of_urls, definitely_no_more_pages ) = gallery.GetPage( self._query, page_index )

> File "include\ClientDownloading.py", line 482, in GetPage

> ( page_of_urls, definitely_no_more_pages ) = self._ParseGalleryPage( data, gallery_url )

> File "include\ClientDownloading.py", line 1493, in _ParseGalleryPage

> json_object = json.loads( processed_raw_json )

> File "json\init.py", line 339, in loads

> File "json\decoder.py", line 364, in decode

> File "json\decoder.py", line 380, in raw_decode

> ValueError: Expecting object: line 1 column 120911 (char 120910)

What am I doing wrong?


 No.2179

Is there a way to change keyboard shortcuts for the media viewer? On laptop it's easier to just use the keyboard than to use the mouse with it. I'd also like to change what you use to zoom in and out.


 No.2180

I don't know if it's appropriate to put these in the IPFS guide but I want to make sure they're seen

>>2128

I think those script and addons are very helpful to people who want to make using IPFS easy outside of hydrus itself, like on this board, other boards, or other sites.

With them people can copy just the hash from hydrus and post it anywhere, then anyone with the scripts will get a clickable link to the file which redirects to their local daemon.

The only issue is the userscript only does it on page loads so you have to refresh the page to turn hashes into links if the thread updates.

For example, the text:

QmP6BNvWfkNf74bY3q1ohtDZ9gAmss4LAjuFhqpDPQNm1S

would turn into:

http://gateway.ipfs.io/ipfs/QmP6BNvWfkNf74bY3q1ohtDZ9gAmss4LAjuFhqpDPQNm1S

automatically

Then when you click it with the addon installed the link will be redirected to whatever gateway you want (configurable), by default it's localhost with the default port.

So the gateway link gets redirected to

http://127.0.0.1:8080/ipfs/QmP6BNvWfkNf74bY3q1ohtDZ9gAmss4LAjuFhqpDPQNm1S

automatically again

I hope that's not too verbose.


 No.2181

>>2180

I should also mention, I don't know about the chrome one but the Firefox addon detects if the daemon is running and will enable/disable redirects automatically by default so it shouldn't ever give you issues even if your daemon isn't running.


 No.2182

Windows defender is tagging opencv ccalib something as a trojan :/


 No.2189

>>2173

>In preparation for the new cache layer

> This search domain is so massive, computationally heavy, and so very rarely used, that it is ultimately best to just not support it going forward.

Actually looking forward to this. My client.db is at about 10GB now, with about 1.4mil files added. The only thing that really slows down is large searches of course. Keep up the good work!


 No.2195

Hey, anon who requested the source field/known URLs feature.

I tried it out and it works nicely for files that were downloaded through Hydrus, but it obviously does nothing for files that were imported.

I'd appreciate it if you added in some way to manually set URLs for images, so that it can be used like a source field similar to Paheal or Gelbooru.


 No.2201

File: 1457210019926.jpg (447.88 KB, 2455x1609, 2455:1609, 57a44abb948a096032a44d4999….jpg)

>>2177

Thank you for this report–it looks like tumblr changed their API just slightly. I have fixed the parser for next week. Let me know if it doesn't work for you.

>>2179

Shortcuts are a bit of a mess right now. There is an ugly options panel at file->options->shortcuts. You can change fullscreen_switch, and previous/next, but not zoom stuff yet.

I would like to rewrite and clean up all the shortcuts in the program, making every action customisable and clean to edit, but it'll be a big job. I will have it on the list of features to vote for, then next time that comes around, so please vote for that if you care about it most of all.

>>2180

That's a good idea, thank you. I'll add a 'here are some add-ons that help you use multihashes in browsers' bit.

>>2182

Hmm, my (Win 10) Windows Defender doesn't. I have opencv_ccalib310.dll at 252,928 bytes. It was last modified 26th Jan 2016 at 3:45pm Central Time (I think that modified stamp propagates through the extract/installer). Do you have the same?

>>2195

I am thinking of listing the known urls in the media viewer, top-right, below where ratings and remote file services go. I can have them work like regular hyperlinks on the hover window. I hadn't thought of editing them–maybe I could do right-click->edit urls for that control or something?


 No.2202

File: 1457225205775.png (10.36 KB, 405x487, 405:487, example.png)

>>2201

>I am thinking of listing the known urls in the media viewer, top-right, below where ratings and remote file services go. I can have them work like regular hyperlinks on the hover window.

Sounds like a good idea.

I also had an idea of putting it in the sidebar under the tags for the selected image, like this image I mocked up.

That might take up a bit of room for people who don't want it though, maybe it could be hidden with an option.

I'd be more than happy with either idea though.

>I hadn't thought of editing them–maybe I could do right-click->edit urls for that control or something?

That would work nicely.

The reason I'd like to manually edit that is because I already have my image collection downloaded, so it'd be a bit easier to import my collection as is, and then add the URLs.



[Return][Go to top][Catalog][Post a Reply]
Delete Post [ ]
[]
[ home / board list / faq / random / create / bans / search / manage / irc ] [ ]