Hello there. I have run into an issue scraping from devaintart I get a "typeError" and a failed download. I coulden't find anything in the help or FAQ so i Thought i'd post here.TypeError'NoneType' object has no attribute '__getitem__'Traceback (mo

Name
Email
Subject
Comment *
File	Select/drop/paste files here
* = required field	[▶ Show post options & limits] Confused? See the FAQ.

Embed	(replaces files and can be used instead)
Options	Do not bump (you can also write sage in the email field) Spoiler images (this replaces the thumbnails of your images with question marks)
Password	(For file and post deletion.)
Allowed file types:jpg, jpeg, gif, png, webm, mp4, swf, pdf Max filesize is 8 MB. Max image dimensions are 10000 x 10000. You may upload 1 per post.

File: 1430534760949.jpg (57.25 KB, 640x480, 4:3, 1430508903184.jpg)

Anonymous 05/02/15 (Sat) 02:46:00 No.695

Hello there. I have run into an issue scraping from devaintart I get a "typeError" and a failed download. I coulden't find anything in the help or FAQ so i Thought i'd post here.

TypeError

'NoneType' object has no attribute 'getitem'

Traceback (most recent call last):

File "C:\code\Hydrus\build\client\out00-PYZ.pyz\include.ClientDownloading", line 1070, in call

File "C:\code\Hydrus\build\client\out00-PYZ.pyz\include.ClientDownloading", line 1153, in _GetArgs

File "C:\code\Hydrus\build\client\out00-PYZ.pyz\include.ClientDownloading", line 174, in GetFileAndTags

File "C:\code\Hydrus\build\client\out00-PYZ.pyz\include.ClientDownloading", line 454, in GetFile

File "C:\code\Hydrus\build\client\out00-PYZ.pyz\include.ClientDownloading", line 449, in _GetFileURL

File "C:\code\Hydrus\build\client\out00-PYZ.pyz\include.ClientDownloading", line 439, in _ParseImagePage

TypeError: 'NoneType' object has no attribute 'getitem'

Anonymous 05/02/15 (Sat) 03:33:59 No.696

File: 1430537639938.gif (74.54 KB, 576x576, 1:1, paneldeponbgs.gif)

Yeah I get this too. I think it happens if the artwork page doesn't have an actual download button on it. You can click most of those images to get the full size right in the page, but Hydrus doesn't seem to recognize them.

Slideshows on pixiv don't work either. At the moment I use Hydrus to download boorus and that's about it.

Scraping is a constant arms race.

Anonymous 05/02/15 (Sat) 11:04:11 No.699

File: 1430564651310.jpg (97.94 KB, 1280x720, 16:9, 2d3d705170240f3f9e4cefeb14….jpg)

>>696

Ah, I see. Good to know I didn't do anything retarded to cause this issue.

>Slideshows on pixiv don't work either

Well, damn.

hydrus_dev ## Board Owner 05/05/15 (Tue) 18:40:58 No.705

File: 1430851259814.jpg (382.87 KB, 1051x1000, 1051:1000, 4e7ae365f0a39718fe8a75e647….jpg)

Hey, sorry for my slow response here. I've had a busy week.

These errors are usually because DA produces some odd html and my parser breaks down–things like the artist including quote marks in their title.

If you can reproduce these, please send me/post here the queries or image page urls, and I'll try to hack a solution to patch the hole.

Finding time to add slideshow support to the pixiv parser is proving a problem.