[ / / / / / / / / / / / / / ] [ dir / animu / dcaco / eris / leftyb / m / oneshota / tingles / vichan ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Catalog   Archive

Winner of the 62rd Attention-Hungry Games
/eris/ - Wherein Is Explained Absolutely Everything Worth Knowing About Absolutely Anything.

November 2018 - 8chan Transparency Report
Name
Email
Subject
Comment *
File
Password (Randomized for file and post deletion; you may also set your own.)
* = required field[▶ Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Options

Allowed file types:jpg, jpeg, gif, png, webm, mp4, swf, pdf
Max filesize is 16 MB.
Max image dimensions are 15000 x 15000.
You may upload 5 per post.


New user? Start here ---> http://hydrusnetwork.github.io/hydrus/

Experienced user with a bit of cash who wants to help out? ---> Patreon

Current to-do list has: 1,485 items

Current big job: final cleanup, then python 3 over Christmas


YouTube embed. Click thumbnail to play.

4435c7  No.10909[Reply]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v333/Hydrus.Network.333.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v333/Hydrus.Network.333.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v333/Hydrus.Network.333.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v333/Hydrus.Network.333.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v333/Hydrus.Network.333.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v333.tar.gz

🎉🎉 Merry v333! 🎉🎉

I was slightly short on time, but I still had a great week. There's some fixes and speedup and a bit of fun.

file viewing statistics

The client now records how often (and for how long) each file has been viewed in the preview window and main media viewer! You will see how many times you hPost too long. Click here to view the full text.

34 posts and 4 image replies omitted. Click reply to view.

af85e4  No.10973

Duplicate processing greatly inflates the view count since you often flip back and forth between two images looking for which is better. Wish to disable it just for the duplicate viewer.




File: 3f8a8d22364b1de⋯.jpg (111.13 KB, 400x400, 1:1, 1394958218797.jpg)

d5679d  No.9327[Reply]

Here you can ask questions so that the board is not clogged with small threads.

>>6021 has reached its bump limit, so I made a new thread.

335 posts and 62 image replies omitted. Click reply to view.

4bfc2f  No.10960

how can I change the bandwidth limit ?


03212e  No.10964

File: 39aa42902fb0e3e⋯.png (28.51 KB, 487x575, 487:575, ClipboardImage.png)

File: 6be6b7aa6b21e3f⋯.png (13.74 KB, 372x195, 124:65, ClipboardImage.png)

>>10392

pixv isnt working for me. when i punch in a number it just spits out error! in status then says it will expire in an hour. i found the network report mode but it doesnt look like it has any useful information.


3537d7  No.10968

>>10964

I can confirm this exact error message. Only difference for me is the pixiv ID.


6038dd  No.10971

Is there a way to make Hydrus always max the vertical dimensions of the media preview window? It used to behave that way for me but then it stopped, on the same version number I think. In the same vein is there a way to restore the horizontal width of the entire left part of the client (media preview window included in there) once you've changed it, and can you set the dimensions for the media preview window+that entire left part of the client as the new default for all following tabs you open?

Another thing I'd like is to automatically max the media preview window to the image you've selected. Obviously for browsing that isn't usable since images can have any dimension, but I tend to keep the client open on a tab with an image selected, but upon restart I have to manually eyeball scaling the media preview window to the proportions of my screen size and all that. Would be nice to just hit a button to automate it. I don't think any of this functionality exists yet, so I'm just leaving feedback I guess.


6038dd  No.10975

>>10971

Actually the proportions of the left side of Hydrus in my first tab stayed on restart, and the only other tab I had open emulated those proportions. Any following tab I open emulates the first tab proportions as well. So this is quite alright. I remember losing it on restart once though, but maybe I had multiple tabs open, with sizes discrepant from the first tab?

Anyway I won't fuck with the first tab proportions of the left side, since I manually maxed the vertical res and made the right edge pixel perfect to the image it's displaying. So this is good enough for me. It's a hentai page, which is like 16:9 ratio vertically and is fine to standardize across any following tabs.




File: ab23431121b8563⋯.jpg (96.69 KB, 492x650, 246:325, ab23431121b8563a7bc3b7ac57….jpg)

0675b5  No.5115[Reply]

Gonna start another thread because >>173 is becoming too big for most people.

In the tag manager, whenever multiple tags are selected for multiple files with different tags, if you press the del key, the program will still ask you if you want to delete them all or put them all in the selected files. This does not make sense, if I'm pressing the del key it's obvious that I want them gone.

551 posts and 169 image replies omitted. Click reply to view.

35b3df  No.10939

>>10894

Thank you for this report. I believe your client is having trouble finding ffmpeg. In some circumstances, the Linux build has trouble launching external programs. I don't get this on my Ubuntu, so I am still trying to figure it out.

Can you please hit help->about and let me know what it has for ffmpeg? It is probably like 'not found'.

If so, try running help->debug->report modes->callto report mode and try importing/showing a video. It should say in its popup spam something about "Attempting to launch…". Please let me know that data, and if it looks sensible to you or not. (email if private, or just scrub the exact directory and post it here).

You might have luck putting a static ffmpeg executable in the install_dir/bin directory. There should be a .txt with more info in there, but I'd also like to fix this issue more generally, if you are open to working on it as well.


e973b1  No.10961

File: e2841b84537aa66⋯.png (172.82 KB, 580x935, 116:187, hydrus_bug.png)

>>10939

Sorry it's taken me so long to reply. At help->about, FFMPEG version is listed as "unknown".

Rather than type out the messages, I took a screenshot and cropped out everything but the messages. I got the same message when I tried APNG and WEBM. The APNG was a newer import, while the WEBM was from before the problem started. The exception shows up with report mode off.

I took some initiative and tried messing with the settings in file->options->media, but nothing worked. I tried setting the "Prefer system FFMPEG" flag, the "BUGFIX:Load images with PIL" flag (this one was already checked), and the "BUGFIX:Load gifs with PIL instead of OpenCV" flag, but none of them did anything that affected the problem (I had report mode off at the time, though).

I checked out my install_dir/bin directory, and there was no FFMPEG in there. I copied my FFMPEG executable from /usr/bin/ffmpeg to the bin directory in my hydrus folder, but nothing changed.


e973b1  No.10962

>>10961

>I got the same message when I tried APNG and WEBM

Obviously, not the exact same message. The memory addresses were different.


4dbbad  No.10969

>>10846

Usual maintenance(when PTR isn't involved) and shutdown always works fine, the only real hang seems to occur when processing deleted mappings in a PTR update. (whether triggered by hand or during idle/shutdown maintenance)

I must stress that the issue does not occur when processing PTR updates that simply add mappings. Starting to wonder if my database's not busted somewhere.

client.exe's disk usage drops to 0 when the hang occurs, and stays mostly fixed CPU/RAMwise.

Forcefully shutting down the client at this point(no other real way to do it) clears the process out immediately. The client profile remains empty, so I don't have precise information as to where the hang occurs.


04b410  No.10972

File: a90f6bdcea5cf24⋯.png (77.69 KB, 728x569, 728:569, ClipboardImage.png)

File: bf205c610e1360a⋯.png (22.12 KB, 484x464, 121:116, ClipboardImage.png)

>>10695

So from what I can tell, I was having the same problem with Pixiv as >>10653 but I followed the advice to delete the definitions and add defaults but now everything is broken. None of the gallery options are available now and makes Hydrus largely useless to me as a scraper.

How do I do a complete reset on the downloaders in Hydrus? Will reinstalling help or just waiting till the next release overwrite this?




File: 1426721772716.png (100.78 KB, 1624x1081, 1624:1081, 1327614072601.png)

7f2c0e  No.471[Reply]


Drag and drop windows with tag rules. Show two windows side by side and one window can be programmed with the rule "ADD tag foo" and the other one has the rule "REMOVE tag foo, ADD tag bar" and you can drag and drop files to them.

Deriving tags from regex of other tags/namespace tags. A file has the tag "filename:big_ugly_name" and we could regex that namespace for another tag.

Tag sets with hotkeys: save a set of tags under a hotkey so it's quick to add them to a file while filtering

Opaque window behind tag list in the corner so it doesn't get hidden by picture background

Option to default certain mime types to be excluded from slideshow and only open externally, will help with videos with odd codecs that don't preview in the slideshow correctly

Option to specify hamming distance in "find similar images", you can't change the option once it's in the filter window and you have to enter the hash manually in the "system:similar to" option
612 posts and 191 image replies omitted. Click reply to view.

2353ee  No.10588

It would be cool if, when your comparing duplicates, you could press a button to highlight where the perceived differences are. Like a heatmap or something like that.

Sometimes it takes me a while to see where the differences are.


dcd4be  No.10743

>>10323

Here are some magic numbers for adding moar files

AVI video files for older anime: 52 49 46 46 (http://filext.com/file-extension/AVI)

AIFF for OSX music 46 4F 52 4D (http://filext.com/file-extension/AIFF)

AAC for OSX lossy audio FF F9 5C 80

M4A for MP4 interal audio 00 00 00 20 66 74 79 70 4D 34 41 (https://filesignatures.net/index.php?search=m4a&mode=EXT) or 66 74 79 70 4D 34 41 20 (https://www.garykessler.net/library/file_sigs.html)

APE for old school cassettes and records 4D 41 43 20 (http://filext.com/file-extension/APE)

OPUS is in the same container as OGG

EPUB has 50 4B 03 04 (http://filext.com/file-extension/EPUB)

MOBI has 42 4F 4F 4B 4D 4F 42 49 (http://filext.com/file-extension/MOBI)

DJVU has 41 54 26 54 46 4F 52 4D (http://filext.com/file-extension/DJVU)

Postscript has 25 21 50 53 or C5 D0 D3 C6 (more at http://filext.com/search.html?hl=en&q=postscript)


2bf658  No.10867

Self-documenting notes in Parsing Scripts like the ones in https://stackoverflow.com/a/41903882

https://github.com/tikitu/jsmin/ and https://pypi.org/project/jsmin/ has the repos

Idea: Lint-out the comments when importing the scripts, NOT when generating the script image/text file


4aa4d2  No.10951

Simply reject this to prevent rendering issues https://en.wikipedia.org/wiki/Right-to-left_mark


# Bidi Class (listing UnicodeData.txt, field 4: see UAX #44: http://www.unicode.org/reports/tr44/)
# Unlike other properties, unassigned code points in blocks
# reserved for right-to-left scripts are given either types R or AL.
#
# The unassigned code points that default to AL are in the ranges:
# [\u0600-\u07BF \u0860-\u086F \u08A0-\u08FF \uFB50-\uFDCF \uFDF0-\uFDFF \uFE70-\uFEFF
# \U00010D00-\U00010D3F \U00010F30-\U00010F6F \U0001EC70-\U0001ECBF \U0001EE00-\U0001EEFF]
#
# This includes code points in the Arabic, Syriac, and Thaana blocks, among others.
#
# The unassigned code points that default to R are in the ranges:
# [\u0590-\u05FF \u07C0-\u085F \u0870-\u089F \uFB1D-\uFB4F \U00010800-\U00010CFF \U00010D40-\U00010F2F
# \U00010F70-\U00010FFF \U0001E800-\U0001EC6F \U0001ECC0-\U0001EDFF \U0001EF00-\U0001EFFF]
#
# This includes code points in the Hebrew, NKo, and Phoenician blocks, among others.


4aa4d2  No.10952

>>10951

or just

[\u0590-\u08FF\uFB1D-\uFDCF\uFDF0-\uFDFF\uFE70-\uFEFF
\U00010800-\U00010FFF\U0001E800-\U0001EFFF]




YouTube embed. Click thumbnail to play.

3f9700  No.10810[Reply]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v332/Hydrus.Network.332.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v332/Hydrus.Network.332.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v332/Hydrus.Network.332.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v332/Hydrus.Network.332.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v332/Hydrus.Network.332.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v332.tar.gz

I had a great week catching up on a whole bunch of small jobs.

rolling session backups

The program now automaticaly makes up to ten rolling backups (i.e. it keeps the ten newest saves) of your sessions! This includes the 'last session' backup used to restore the program on boot, so if you accidentally close something very important and can't get back to it, or if your session breaks for some reasoPost too long. Click here to view the full text.

28 posts and 9 image replies omitted. Click reply to view.

3f9700  No.10906

>>10876

>>10878

>>10880

>>10901

I'm still laughing/in disbelief about tumblr's decision. I thought after the uproar they would swiftly reverse the decision, but I guess they don't want to subsidize free porn bandwidth any more. The only conclusion I can make is Verizon just don't have a real business plan for it. No idea why they took it on in the Yahoo purchase. What a way to kill a brand.


f87c85  No.10917

Is their a way to search through Notes or see which images have Notes written on them?


dd95da  No.10933

>>10859

Thanks, 0.8 works better, it scrolls a full page per tick now. I have my scroll length set to 5. One page is about 5½ thumbs high.

I think this might also be related to the fact that I have Windows 10 set to 125% scale, Hydrus doesn't seem to handle that quite correctly (for example when resizing the width of the tagging panel to the left of the thumbnail view).


3f9700  No.10937

>>10917

Not yet, but I'd like to present that information better in several ways. Adding search would also be useful.


3f9700  No.10938

>>10933

I hope to check out high-dpi stuff in the new year. The new wx is supposed to be able to handle it better, so I'll have a look and see if I can figure out what flag I need to set or whatever. I have a 4k monitor now, so I can test this better.




File: cd445bfd5f16aa6⋯.gif (119.74 KB, 270x270, 1:1, cd445bfd5f16aa6939fa75be23….gif)

6adc1b  No.10891[Reply]

I was a little short on hydrus time, but I otherwise had a great week. As well as some normal bug fixes, and another new performance-increasing cache, I've prototyped a fun new 'viewing stats' system.

The release should be as normal tomorrow.

01eb3e  No.10892

File: df31cdacdea1b48⋯.png (333.68 KB, 7845x2030, 1569:406, temporary.png)

IT IS HAPPENING


cc2411  No.10896

>>10892

I can't wait.

It's gonna be three-three-three!

Yay!


e94331  No.10897

>>10896

1/3 of the millenium… time goes by fast


cc2411  No.10899

>>10897

I don't really get what you're saying… it was simply a play on "three three three" with the image, since NS Germany is referred to as the "Third" Germany as well.


e94331  No.10903

>>10899

333 is one third of 1000, i.e. the Millennium Reich




File: 1a9285021606585⋯.mp4 (12.52 MB, 1280x720, 16:9, 1a92850216065854fb2553edc6….mp4)

f23851  No.10654[Reply]

Due to some funny voting, I am considering the poll finished earlier than expected and will start work on an API prototype in the new year. (details >>10845) Thank you everyone for voting–I really appreciate the feedback.

Here is the poll if you would like to review what was overall popular and not:

https://www.poll-maker.com/poll2148452x73e94E02-60

This thread remains available for discussion of anything related to the poll.

Thanks everyone!

47 posts and 3 image replies omitted. Click reply to view.
Post last edited at

22de06  No.10865

>>10864

Please read this https://github.com/jaseg/python-mpv to see how easy that is

Might as well plug this in if people want it https://github.com/rg3/youtube-dl for downloading from YouTube, Soundcloud and all the alt-tube sites

Also regarding the API, according to most mobile devs, they would prefer Danbooru/Moebooru API over everything else, so I drafted an API spec for Hydrus https://ghostbin.com/paste/hghv2 (Gelbooru could come later)

And Nori dev (tjg1) says the downloader script GUI is overengineered, whatever.


83bee5  No.10868

Sorry lads, but how can I bulk-download booru-imageboard image files in bulk?


83bee5  No.10869

File: 2ec22a631ee863c⋯.png (10.21 KB, 427x185, 427:185, temp.png)

>>10868

I get the error of pic related.

I already followed instructions to reinstall the .dll for this, so I am at a loss what to do now.

Pls halp ;_;


83bee5  No.10870

>>10869

>>10868

Sorry for not putting this all into one post - but I tried to install "bionus" "Imgbrd grabber" by the way. Is something like this possible with hydrus!? I never tried…


70511e  No.10882

>>10870

Imgbrd is a separate project that does similar things, this board is not responsible for it, best ask in https://github.com/Bionus/imgbrd-grabber/issues

Bionus & pals has promised to make things easier for us to import data to Hydrus, but it is not yet well integrated.

https://github.com/Bionus/imgbrd-grabber/issues/1001 and https://github.com/Bionus/imgbrd-grabber/issues/588 has some notes




File: 9e8801ef86eb801⋯.png (71.92 KB, 300x300, 1:1, pytern.png)

856a97  No.10837[Reply]

I'm having a lot of trouble getting hydrus to run from source.

Could not import lz4.

I have lz4 installed.

Traceback (most recent call last):
File "H:\Hydrus Network\client.py", line 20, in <module>
from include import ClientController
File "H:\Hydrus Network\include\ClientController.py", line 14, in <module>
import ClientCaches
File "H:\Hydrus Network\include\ClientCaches.py", line 1, in <module>
import ClientDefaults
File "H:\Hydrus Network\include\ClientDefaults.py", line 2, in <module>
import ClientData
File "H:\Hydrus Network\include\ClientData.py", line 3, in <module>
import ClientDownloading
File "H:\Hydrus Network\include\ClientDownloading.py", line 12, in <module>
import pafy
File "C:\Python27\lib\site-packages\pafy\__init__.py", line 7, in <module>
from .pafy import new
File "C:\Python27\lib\site-packages\pafy\pafy.py", line 52, in <module>
"pafy: youtube-dl not found; you can use the internal backend by "
ImportError: pafy: youtube-dl not found; you can use the internal backend by setting the environmental variable PAFY_BACKEND to "internal". It is not enabled by default because it is not as well maintained as the youtube-dl backend.

I have youtube-dl installed as well. Setting the PAFY_BACKEND fixes this.

2018/12/01 21:22:43: Traceback (most recent call last):
File "H:\Hydrus Network\include\ClientController.py", line 1241, in THREADBootEverything
self.InitModel()
File "H:\Hydrus Network\include\ClientController.py", line 602, in InitModel
session_manager = self.Read( 'serialisable', HydrusSerialisable.SERIALISABLE_TYPE_NETWORK_SESSION_MANAGER )
File "H:\Hydrus Network\include\HydrusController.py", line 491, in Read
return self._Read( action, *args, **kwargs )
Post too long. Click here to view the full text.

c0b6b0  No.10843

Hey, thank you for this report.

I think you have an unlucky older version of the client here. My recommendation is to update to a more recent version.

More specifically:

lz4 started having trouble importing recently in a variety of situations, I am not sure why. I put some time into it but couldn't figure it out and will revisit it in the new year when I am on python3. It is not required.

pafy and youtube-dl shouldn't be a big deal either, but I guess the new version complains if it is missing. I think you can fix this on the python end by installing 'pip install youtube-dl', which I guess adds some python bindings to youtube-dl and is actually what pafy is looking for here. Pafy (which does some borked youtube downloading) is only needed for some experimental code, so I will change the code to no longer dump out if import fails.

The ordered_dict issue turned up a few weeks ago, when requests updated and could no longer unpickle (load from a serialised object) its sessions. The code in newer versions should recover from this error and regenerate empty sessions for you this one time.

Please let me know how you get on.


856a97  No.10861

>>10843

I was afraid of updating as my hydrus db has surpassed my backup drive in size. I updated to 332 (from 317) anyway, everything went fine phew.

Running from source now yields this error:

Could not import lz4--nbd.
Traceback (most recent call last):
File "H:\Hydrus Network\client.py", line 20, in <module>
from include import ClientController
File "H:\Hydrus Network\include\ClientController.py", line 14, in <module>
import ClientCaches
File "H:\Hydrus Network\include\ClientCaches.py", line 1, in <module>
import ClientDefaults
File "H:\Hydrus Network\include\ClientDefaults.py", line 2, in <module>
import ClientData
File "H:\Hydrus Network\include\ClientData.py", line 3, in <module>
import ClientDownloading
File "H:\Hydrus Network\include\ClientDownloading.py", line 2, in <module>
import ClientNetworkingDomain
File "H:\Hydrus Network\include\ClientNetworkingDomain.py", line 3, in <module>
import ClientParsing
File "H:\Hydrus Network\include\ClientParsing.py", line 4, in <module>
import ClientNetworkingJobs
File "H:\Hydrus Network\include\ClientNetworkingJobs.py", line 9, in <module>
import HydrusNetworking
File "H:\Hydrus Network\include\HydrusNetworking.py", line 9, in <module>
import ssl
File "C:\Python27\lib\ssl.py", line 126, in <module>
from _ssl import HAS_SNI, HAS_ECDH, HAS_NPN, HAS_ALPN, HAS_TLSv1_3
ImportError: cannot import name HAS_TLSv1_3


856a97  No.10875

File: 1333fe873d20311⋯.png (45.26 KB, 752x674, 376:337, trwaiuna.png)

>>10861

I removed the _ssl.pyd file that comes with the hydrus installer and it seems to be working after doing that. Same thing for the lz4*.pyd files. No more import errors.


c0b6b0  No.10887

>>10875

Great, I am glad you figured this out. Let me know if you encounter any more problems.




YouTube embed. Click thumbnail to play.

de7a31  No.10747[Reply]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v331/Hydrus.Network.331.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v331/Hydrus.Network.331.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v331/Hydrus.Network.331.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v331/Hydrus.Network.331.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v331/Hydrus.Network.331.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v331.tar.gz

I had a good week. The login manager is done, I have added proxy support, and some tag stuff is faster!

login manager

The 'manage logins' dialog has some small usability improvements, and it also has a neat 'do login now' button to easily manually attempt logins.

The network->data->review session cookies panel now hides 'ePost too long. Click here to view the full text.

27 posts and 4 image replies omitted. Click reply to view.

393f71  No.10811

>>10808

For me, I always take a url like

https://pbs.twimg.com/media/DrkOeeqU0AUdsbI.jpg:large

and turn it into

https://pbs.twimg.com/media/DrkOeeqU0AUdsbI.jpg:orig

I get the first url from just "view image"'ing them in the browser.


b3b9b9  No.10812

>>10747

I said this a while back, you may as well stop with exhentai/e-hentai

I found a script that will get download links, it will stager the downloads, and even then, at 1 dl a minute, they still catch it, its just not worth the effort form them.


5f5bbf  No.10822

>>10812

What were you trying to download?

I sometimes open various(10-20) doujinshis at once and use a full page script to leave them all opening at once to then save them, but it's a short rapid burst.

If you're downloading a lot of shit over an extended uninterrupted period of time that could be why.


b3b9b9  No.10823

>>10822

the last one I downloaded was an 8 page comic with everything spaced out 1 minute, I did all my testing on very small downloads and regardless of what I did, 1-1 week long lockouts.

It seems they want you to pay them for the ability to download things, as 20$ gets you a weekly 5gb pass on downloads, something I would gladly pay, but I need to link bank accounts and do money transfers for cryptocurrencies, and i believe my bank was one that was one that was punishing people for even trying.


de7a31  No.10847

>>10811

>>10808

Thanks. I hadn't heard of the jpg-orig trick. Hydrus currently does the :orig conversion, which works well as long as the artist themselves didn't originally upload a 350x400 80% quality jpg. :^)

I know that twitter can provide direct mp4 links for videos, but I haven't figured out a way to parse this info. This service provides it:

https://twitter.com/this_vid

But takes a couple of minutes to produce an answer, so my guess is they manually request it from twitter using a legacy "I'm an old phone" http header or something and then forward the link. Normal twitter video works with some DASH streaming or something that we can't handle (yet).

If you discover a way to get simple mp4 links for twitter vids, please let me know!




File: e499805dcaa9f53⋯.jpg (142.34 KB, 1024x715, 1024:715, grugvote.jpg)

428eab  No.10829[Reply]

you guys know that there are people who actually use hydrus for searching their files instead of just downloading every trash they can find? so since people exist who want to actually use hydrus, it's way more useful to have or-search instead of a shitty api that only retards would benefit from (that's not true but or-search is easier to implement and IT IS USEFUL.. especially if you use your own tagging style instead of the bs ptr tagging system which is just stupid imo) - end of discussion

481401  No.10830

Is that why hydrus_dev spent the last year working on the downloader engine? I guess he wasn't actually working on Hydrus then according to you.

Fuck off with your attitude


428eab  No.10833

>10830

Imagine actually believing this is a serious post


116b61  No.10866

>>10829

< Not valuing API because archiving is a waste of time

When everything is deleted off the internet constantly you will regret that.




File: ea31ab670c8dee7⋯.png (12.55 KB, 340x175, 68:35, mariadb-usa-inc.png)

928501  No.9068[Reply]

ITT: create proposals for making Hydrus more optimized.

Proposal: Why can't Hydrus switch to MariaDB?

If it is faster, then it should be better. The only trouble is having the need to rewrite the queries, which from an SQL standpoint should be a non-issue, right?

List of Databases with Open Source License and Open Source APIs:

SQLite - Currently used in Hydrus, has minimal features

MySQL - A more well-rounded SQL Database with user management

PostgreSQL - An SQL with complex features with less performance

MariaDB - SQL/NoSQL database with heavy optimizations

ElasticSearch - A literal search engine instead of a normal Database

Teradata - IDK

https://www.digitalocean.com/community/tutorials/sqlite-vs-mysql-vs-postgresql-a-comparison-of-relational-database-management-systems

https://www.infoworld.com/article/2611812/mysql/mysql-face-off--mysql-or-mariadb-.html

36 posts and 2 image replies omitted. Click reply to view.

c145f5  No.10362


f513f2  No.10599

>>10361

Got some more comparative papers 4U

https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8346440 (A Comparative Analysis of SIFT, SURF, KAZE, AKAZE, ORB, and BRISK)


928501  No.10742

https://en.wikipedia.org/wiki/Pointwise_mutual_information

Pointwise mutual information between tag X and tag Y is the logarithm of (num. of images with both tags) * (total image count) / ((num of images with tag X) * (num of images with Tag Y))

PMI can be used to find possible tag siblings

https://en.wikipedia.org/wiki/Conditional_entropy

Conditional entropy of X given Y is ( (num. of images with both tags) / (total image count) ) * logarithm of ( (num of images with tag X) / (num. of images with both tags) )

CE can be used to find possible tag parents and children


7cad32  No.10805

Nim is low-level Python, Crystal is low-level Ruby, both would be easy for the rest of us (and hopefully the dev) to pick up.

Doing so would mean that Hydrus would be at least twice as fast in certain departments when compared to non-NumPy Python.

(Also D is a C replacement, Go and Kotlin are Java replacements, but those are very different from the syntax of Python)

Are there applications where low-level languages DON'T apply? Math calculations, in that case use SciPy/NumPy for less work.

Some benchmarks:

https://github.com/kostya/benchmarks

https://github.com/drujensen/fib

https://github.com/frol/completely-unscientific-benchmarks

https://github.com/logicchains/LPATHBench


62ad1c  No.10819




File: 15297a91f85e825⋯.gif (65.9 KB, 298x252, 149:126, 15297a91f85e8257bcf5d2a5ce….gif)

2cbdca  No.10801[Reply]

I had a great week catching up on a whole bunch of small work. There's some faster search, better error recovery, a neat new rolling session backup system, and plenty more.

The release should be as normal tomorrow.



YouTube embed. Click thumbnail to play.

8d1e72  No.10656[Reply]

21 posts and 5 image replies omitted. Click reply to view.

704562  No.10732

WARNING:root:pafy: youtube-dl not found; falling back to internal backend. This is not as well maintained as the youtube-dl backend. To hide this message, set the environmental variable PAFY_BACKEND to "internal".

Traceback (most recent call last):

File "/opt/hydrus/client.pyw", line 20, in <module>

from include import ClientController

File "/opt/hydrus/include/ClientController.py", line 14, in <module>

import ClientCaches

File "/opt/hydrus/include/ClientCaches.py", line 5, in <module>

import ClientRendering

File "/opt/hydrus/include/ClientRendering.py", line 2, in <module>

import ClientImageHandling

File "/opt/hydrus/include/ClientImageHandling.py", line 3, in <module>

import cv2

ImportError: No module named cv2 looks like

opencv update on Arch makes hydrus unable to boot, 3.4.3-5 -> 3.4.4-1


c49475  No.10735

>>10729

>Seems fucking retarded, what's wrong with just having blue boards?

He has done the same thing to 2ch.

His explanation was like this.

If something wrong occurs in an adult board like someone uploading CP and law enforcement will shuts down 2ch entirely.

But as far as 2ch and adult boards called pink server separated and we treat these two as complete different sites.

At least 2ch is kept safe.


8d1e72  No.10737

>>10732

Thanks. I found this after a bit of searching:

https://bugs.archlinux.org/task/60855

https://github.com/opencv/opencv/issues/13202

So I guess those are some places to watch? If the python bindings for cv got messed up in the new version, I should think reverting is the simplest solution for now.

OpenCV is critical to Hydrus's drawing, so I'm afraid there isn't much I can easily do on my end.


8d1e72  No.10738

>>10728

Thank you for reminding me of this. I made a new url class, rolling out tomorrow, that seems to add complete support. (we'll see if after the official split if sfw content/api is still stored on 4cdn domain, which the current watcher goes to)


98bbb3  No.10745

>>10730

>>10729

learned a new thing since posting that.

4chan lost stripe, you cant buy passes with credit cards, this is the reason for the split.




File: e6edf8d86cecbf5⋯.gif (212.87 KB, 250x250, 1:1, e6edf8d86cecbf5e8a4f7a9f40….gif)

318f82  No.10741[Reply]

I had a good week. The login manager is finished–with some better login testing and script-sharing–and I significantly sped up some database tag code.

The release should be as normal tomorrow.



YouTube embed. Click thumbnail to play.

a76f0e  No.10438[Reply]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v328/Hydrus.Network.328.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v328/Hydrus.Network.328.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v328/Hydrus.Network.328.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v328/Hydrus.Network.328.-.OS.X.-.Extract.only.tar.gz

linux

https://github.com/hydrusnetwork/hydrus/releases/download/v328/Hydrus.Network.328.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v328.tar.gz

I had a good week. The login manager is 95% done, and I got some neat ui stuff finished as well.

I am now considering what 'big thing' to work on next. Please see 'next week' below for more details.

login manager

The login manager is first-draft finished. It works and is turned on, but I have not added any new scripts, and I have yet to remove tPost too long. Click here to view the full text.

23 posts and 4 image replies omitted. Click reply to view.
Post last edited at

52e019  No.10557

>>10555

What the actual fug…. I went from version 311 -→ 328 and there were NO ISSUES.

Am I in a dream? Have I killed myself without noticing and am about too get it snatched away and find myself in hell?

Was I hit by a bus and am in heaven?

Bless you guys, I am a happy camper right now.


a76f0e  No.10558

>>10520

>>10512

Hey, I checked this out today but could not reproduce it. The max whitespace on the bottom of a page should not be larger than a thumbnail's height, so I think the problem here is actually that your scrollbars are too tall and so when you scroll down, you are seeing 'invalid' space that isn't being pasted over with white because the gui doesn't think it exists.

I messed around with sizes on my end but couldn't get it–could you please take a screenshot of your whole media window here so I can replicate your pixel sizes exactly? I presume that when you are at 0 margin, your thumbnail height is accidentally like exactly 3 times your media height and there's a +1 I am missing somewhere in a 'should there be a new row of thumbs' check.

Also, if you change the size of your window by a few pixels, does it draw the scrollbars correct, or do you always get too much whitespace as the end?


a76f0e  No.10559

>>10554

>>10553

>>10555

>>10557

Great, I am glad this worked. In truth, I haven't made many significant db changes in a while due to all this downloader work–it has mostly been smaller object updates, which for me are less subject to bit rot.

Let me know if you run into any problems. Things like manage subscriptions are probably in a new location for you and a bit more powerful and complicated. Try dragging and dropping an image tweet URL like this–

https://twitter.com/suzybaeily/status/1059168488244342785

–on your client!


46667d  No.10734

is there a way to view your library on an android device via streaming?


a76f0e  No.10740

>>10734

Not yet. Vote for API here >>10654 .




Delete Post [ ]
[]
Previous [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]
| Catalog | Nerve Center | Cancer
[ / / / / / / / / / / / / / ] [ dir / animu / dcaco / eris / leftyb / m / oneshota / tingles / vichan ]