[ home / board list / faq / random / create / bans / search / manage / irc ] [ ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Catalog

Infinity Never
Name
Email
Subject
Comment *
File
* = required field[▶ Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Options
Password (For file and post deletion.)

Allowed file types:jpg, jpeg, gif, png, webm, mp4, swf, pdf
Max filesize is 8 MB.
Max image dimensions are 10000 x 10000.
You may upload 5 per post.

New user? Start here ---> http://hydrusnetwork.github.io/hydrus/

Currently prioritising: simple IPFS plugin

YouTube embed. Click thumbnail to play.

 No.1855

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v191/Hydrus.Network.191.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v191/Hydrus.Network.191.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v191/Hydrus.Network.191.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v191/Hydrus.Network.191.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v191/Hydrus.Network.191.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v191.tar.gz

I had a good week, but I was a bit short on time and my current dev situation is slightly up in the air. As well as some IRL stuff, I am currently upgrading to new computers and network and generally playing musical chairs with hard drives. I did however write a simple bridge to IPFS and fixed some bugs.

I will not be working much on hydrus next week as I finish moving my network stuff around and set up my new machines. As a result, I do not think there will be a release on the 27th Jan. I will be moving to a new Win 10 development machine, and assuming that all goes well, I will be looking into the Win 10 BSOD that recently appeared, so there might be a simple release that fixes that. Or, if there is anything critically wrong with today's release, I will put out a hotfix.

As a result, the next regular release should be on the 3rd Feb.

After that, I'm travelling for a week. I doubt I will have much online time, and I won't be able to dev at all, so there also will not be a release on the 10th.

Beyond that, everything should get back to normal.

ipfs

I have added a new IPFS service type, which you can add under services->manage services. You put in the IP and port of your IPFS daemon, and there's a little button to test the connection. Once you have that set up, you can go pages->new download page->an ipfs file, which will let you put in a multihash. While developing, I used QmUuNBmjSnDt191j3ZJTt1H3QQUa2mrRco2zf563RPYQeh, which is an image of a keyboard an anon posted in a /tech/ IPFS thread.

If you don't have IPFS and want to try this out, especially if you run Windows, I recommend you just go straight here:

https://gobuilder.me/github.com/ipfs/go-ipfs/cmd/ipfs?branch=release

I used:

https://gobuilder.me/get/github.com/ipfs/go-ipfs/cmd/ipfs/ipfs_release_windows-amd64.zip

Apparently the 0.3.x branch has been buggy for Windows, but it worked fine for me. It's a nice big ipfs.exe that you can just go–

ipfs daemon

–to and you are up and running.

The code on my end is rough and prototype. The error handling is bad, and the services->review services ipfs panel is placeholder, but I hope you can get it to work for one file or another. In future, I would like to add IPFS file upload and multihash->clipboard from a thumbnail's right-click menu so you should be able to effect very basic P2P between hydrus clients.

full list

- added ipfs service type

- added simple ipfs service gui to manage and review services windows

- added simple ipfs download and import to pages menu

- split confused service data object into a bunch of more flexible and readable subclasses

- raw url downloads are now powered by 'requests' rather than my hacked http engine, and work a hell of a lot better. more to follow

- raw url downloads now pause and cancel correctly

- optimised some a/c cache clearing in mapping update processing

- optimised content update object -> db yield logistics

- added no-daemons command line switch to disable all daemons

- added no-wal command line switch to disable WAL journalling for the db

- if the db fails to read a new WAL-journalled db file it has just created, it will delete the file and attempt to recreate the db, never trying WAL again

- changed the way the db writes big repo syncs to disk so that the job can be abandoned much more quickly

- improved local file not found error to state the directory or exact path that was the problem

- fixed some socket-level error reporting (I think timeout was part of this)

- the petition approval and denial client-to-server network commit is broken up into smaller steps to reduce server lag and the overall likelihood of timeouts

- subscriptions will no longer add files to their 'successful files' button when the file's url seemed new but it actually was previously deleted

- subscriptions will now identify themselves with an additional popup message when they encounter critical errors during sync

- editing a clientside service will force a reset of the appropriate session cache, so if you change access key, the account changes will be reflected immediately

- the import files dialog will no longer spam error popups on uninteresting or empty files–its 'parsing complete' statement is more verbose instead

- the 1.5s gap between parsing complete and the buttons being enabled is also removed. this was supposed to be helpful, to give you a moment to check the files were as expected, but in the end it was just annoying

- fixed a typo in some thumbnail error catching and regeneration

- improved my network code syncing, so linux and os x releases are cleared out of many old files

- misc code cleanup

next week

Again, there will probably not be anything more than a very simple bugfix release next week. I'll be mostly doing IRL stuff, and if I finish that early, I'll be taking a little time off. I will make a reminder and general update on what's going on post on the 26th.

 No.1857

Making sure this post was seen >>1780

Outside of that I just want to request a feature for the long future, if possible could you add a way to wrap multiple files to an ipfs hash that simulates this ipfs command

ipfs add -w file1 file2 file3...

the -w flag wraps the files in a directory object, that way you can link out a single hash that people can get to retrieve all the files, for example here is a Yume Nikki directory:

QmfDuSNTkr4SNPLDbTnL87rKszjHgU5jFQagrkpyfByeCG

you can do

ipfs get QmfDuSNTkr4SNPLDbTnL87rKszjHgU5jFQagrkpyfByeCG

to get/download the whole directory

you can do 

ipfs ls QmfDuSNTkr4SNPLDbTnL87rKszjHgU5jFQagrkpyfByeCG

to see all the files in it and their hashes

ipfs object links *hash*

and

ipfs object get *hash*

are other ways to get these in different formats, you might be interested in this

https://ipfs.io/docs/commands/#ipfs-object-get

What I'm asking for is essential an IPFS replacement for the "share>on local booru" feature, I just want a quick way to select multiple images and share them with someone else.

I haven't looked into how you'd do this with the API yet, I'm just using the cli invocations as examples, you'd probably want to pull the data itself some other way, I'm not sure.

Hope your migration and travel goes well Hydrus.


 No.1858

>>1857

It should be noted my node is running 0.4.x which is not compatible/fetchable with 0.3.x unless someone running 0.3 also has the content. Their migration tool documentation suggest this kind of incompatibility shouldn't happen again in the future or transitions will be automated/handled.


 No.1859

File: 1453357421197.png (86.71 KB, 531x798, 177:266, 16-01-21_17-21-15.png)

>ipfs daemon

>–to and you are up and running.

https://www.youtube.com/watch?v=ZLPj5iBeIfk


 No.1861

File: 1453358418879.jpg (159.01 KB, 456x458, 228:229, 4671f44fbc0a37d354f043656c….jpg)

>>1859

Changed a few address configs

works now


 No.1862

>>1855

It's a bit of a shame that, running windows 10, I basically can't use hydrus at the moment. It's making the amount of tabs in my browser grow. Soon I'll be more browser tabs than man. Send help.


 No.1863

File: 1453374458023.png (56.23 KB, 977x127, 977:127, 16-01-21_22-06-54-Hydrus_C….png)

>>1862

works on my machine™


 No.1864

File: 1453378778269.png (10.42 KB, 390x283, 390:283, 2Oi4PNR[1].png)

>>1855

Thumbnail error guy here. Curious error.


 No.1928

File: 1454177714772.jpg (6.59 MB, 5616x3496, 702:437, 2c4c459d9b2e03af4a176583d7….jpg)

>>1857

Thank you for this. I think that is the direction I would like to head.

>>1862

>>1863

A user discovered that it was bad Nvidia drivers! The 361.43 drivers cause BSODs in photoshop and hydrus, wew. The new 361.75 should be out now, and it seems to fix everything.

>>1864

That's interesting, thank you. If you get that again, and after the new Nvidia drivers, please post the tracebacks on those. Or you can dig through your client.log and find them.


 No.1929

>>1928

>A user discovered that it was bad Nvidia drivers!

I'll try and verify that for you, but I'm dubious.

Hydrus worked fine on my Win10 desktop with the "bad nvidia driver". Hydrus only BSOD'd on my laptop with intel GPU and nvidia optimus. I don't beileve hydrus was invoking the nvidia GPU on the laptop.


 No.1937

>>1929

Seems to me that the BSOD was limited to laptops. I didn't really do too much research, but I certainly have one.

>>1928



2016/01/30 23:16:20: Exception:
2016/01/30 23:16:20: WindowsError

[Error 32] The process cannot access the file because it is being used by another process: u'D:\\Hydrus Network\\db\\client_thumbnails\\3a\\3ad8091e25fb52d06a74383a94d1d81e77e80bc89c4e44c141cd08da451377d3_resized'

Traceback (most recent call last):
  File "C:\code\Hydrus\include\ClientCaches.py", line 1015, in _GetResizedHydrusBitmapFromHardDrive
WindowsError: [Error 32] The process cannot access the file because it is being used by another process: u'D:\\Hydrus Network\\db\\client_thumbnails\\3a\\3ad8091e25fb52d06a74383a94d1d81e77e80bc89c4e44c141cd08da451377d3_resized'

2016/01/30 23:16:21: Exception:
2016/01/30 23:16:21: NotFoundException

The thumbnail for file 3ad8091e25fb52d06a74383a94d1d81e77e80bc89c4e44c141cd08da451377d3 was found, but it would not render for the above reason. Furthermore, the faulty thumbnail file could not be deleted. This event could indicate hard drive corruption, and it also suggests that hydrus does not have permission to write to its thumbnail folder. Please check everything is ok.

Traceback (most recent call last):
  File "C:\code\Hydrus\include\ClientCaches.py", line 1021, in _GetResizedHydrusBitmapFromHardDrive
NotFoundException: The thumbnail for file 3ad8091e25fb52d06a74383a94d1d81e77e80bc89c4e44c141cd08da451377d3 was found, but it would not render for the above reason. Furthermore, the faulty thumbnail file could not be deleted. This event could indicate hard drive corruption, and it also suggests that hydrus does not have permission to write to its thumbnail folder. Please check everything is ok.

2016/01/30 23:16:22: Exception:
2016/01/30 23:16:22: IOError

cannot identify image file u'D:\\Hydrus Network\\db\\client_thumbnails\\b2\\b292bea31fe91ebd64ec7afb5b8158e7d4743482cffa264d8d9b9e04177312b0_resized'

Traceback (most recent call last):
  File "C:\code\Hydrus\include\ClientCaches.py", line 1000, in _GetResizedHydrusBitmapFromHardDrive
  File "C:\code\Hydrus\include\ClientRendering.py", line 27, in GenerateHydrusBitmap
  File "C:\code\Hydrus\include\HydrusImageHandling.py", line 75, in GeneratePILImage
  File "c:\python27\lib\site-packages\PIL\Image.py", line 2286, in open
IOError: cannot identify image file u'D:\\Hydrus Network\\db\\client_thumbnails\\b2\\b292bea31fe91ebd64ec7afb5b8158e7d4743482cffa264d8d9b9e04177312b0_resized'

There you go.


 No.1944

File: 1454277018339.jpg (120.61 KB, 763x768, 763:768, b5099221a1c69fe8d2d88b2a7f….jpg)

>>1929

I had the same bad drivers on my 8.1 laptop and 10 dev machine and didn't experience the problem, so I don't know what else has to be true to get a BSOD. The conversation about this starts at >>1901 .

>>1937

Thank you for the follow up. I was able to reproduce the problem, and it turns out one of my image libraries was not cleaning itself up neatly on some sorts of errors. I assumed it was, which meant the recovery step could not occur in that case. I have fixed this for v192. You should see some regular 'I found a bad thumbnail' popups, but the recovery step should work, so you'll only see them once. Let me know if you get anything else like this!


 No.1947

The newest PTR update doesn't want to download. It's stuck at saying downloaded up to two days ago, and on close, it says it is downloading, but then stops and closes the db and exits. Reboot, still not updated.


 No.1954

File: 1454443121562.jpg (1.59 MB, 1478x2929, 1478:2929, ec272950ce85c3892e6bc95354….jpg)

>>1947

There's a bug in some of the download code right now for repo download resumes. If you check your install_dir/logs/client.log and scroll to the bottom, do you have this: >>1876 ?

If so, that bug is fixed in v192 for tomorrow. If not, let me know if you do have anything.



[Return][Go to top][Catalog][Post a Reply]
Delete Post [ ]
[]
[ home / board list / faq / random / create / bans / search / manage / irc ] [ ]