Post by stivify in Pls add gui interface

Viewing post in Pls add gui interface

Thanks for your clarifications. Not sure why is Plex isn't displaying the actor image when it is stored locally. But if can scrape the nfo to include the thumb url instead it can display on both KODI and Plex so downloading the image will become optional. For example like this below.

<actor>               
  <name>Nishimiya Yume</name>                     
  <thumb>https://pics.r18.com/mono/actjpgs/nisimiya_yume.jpg</thumb>    
  <role>Actress</role>       
</actor>

The interface for Plex and KODI is very different. Plex is more suitable for PC using with keyboard and mice whereas KODI is more for TV with remote. They are both very dominant and have their own userbase. Plex is a great enhancement for KODI for those who prefer PC. It has more metadata to display, better sorting and filtering etc. You should explore Plex and give it a try, if possible support for both. Thanks!

jav-it4 years ago

Ah, thanks for kind update! Hrm... I could make actor images have a toggle to use the URL instead of local copy. However, the reason why I provide a local copy is so that places like R18 cannot secretly take down content or decommision titles and cause you to loose your entries (However unlikely that is).

Let me do some testing and I'll see what I can come up with. (^_^);

jav-it4 years ago (2 edits)

Hi Stivify,

I just wanted to let you know that I reviewed your request. Now, in addition to making a local mirror, the <thumb> tag is also populated. So if you import it into applications, such as Plex which do not respect all aspects of the KODI standard, actress photos should still show up like normal. All you need to do is download the new 1.5.1 version to pickup the change. (^_^);

The infinity jav gauntlet4 years ago (3 edits)

Hello jav-it I use Plex as well, they have some good documentation about setting up local metadata if you want to have a look.

https://support.plex.tv/articles/200220677-local-media-assets-movies/

https://support.plex.tv/articles/local-files-for-trailers-and-extras/

if Kodi and Plex have different file structure maybe an option can be made to pick what one to use Kodi or Plex?

jav-it4 years ago (1 edit)

Hi,

Thanks for the documentation! This is something that looks quite feasible. Perhaps something to look at after machine translation!

stivify4 years ago

Thanks jav-it for the actor image. A step closer to making it Plex friendly. I am almost certain that Plex is a better option for JAV. Just look at the screen capture below the amount of metadata it can display, specify, sort, filter and categorise. The below is using a Plex agent called PlexJav18.bundle GitHub - alxpnt2/PlexJav18.bundle scraping method which does not add additional files to our local drive. I have compared both, however it has limitations which includes:

1. it doesn't keep a copy in your drive just in case the metadata got erased in r18 (unlikely but possible).

2. It does not include trailer.

3. The folder image is lesser resolution than jav-it which will look blur when expanded.

4. It doesn't change the censored title ***** into actual words.

So jav-it have complemented on these which is great but still need tweaks to make it perfect. i.e. The title to include DVD-ID for easier sorting and searching. There is really no need to have a tag called "JAV" because it will look like a main category instead of sub-category in Plex. We can add a main category ourselves by adding another movie tab, which will look cleaner if we want to have multiple types of other movies in Plex. ^^

jav-it4 years ago (1 edit)

Hi,

Thanks for the feedback. It sounds like Plex could totally be added as an additional output format for scraping. Given some helpfull feedback I got from another thread, it sounds like as long as there is solid documentation as to what plex expects, it could be implemented with a little thought. I just need to plan a bit. (҂⌣̀_⌣́). So how exactly does KODI imported metadata look in Plex anyway? Do you have any clear screenshots? This isn't a small task, so if any work is done on this front, it will have to be after I get machine translation out the door (which is still in progress). It was delayed due to all that Patreon nonsense. (>_<);

In regards to a tag called "JAV", this is important to some users because they do not exclusively collect JAV. So in a very large collection of other videos, the "JAV" tag is important to them. I don't personally need the tag, but some people have indicated it was important so I included it. I don't know if it really hurts anything to be honest.

In regards to metadata disapearing, I can confirm that it does happen and suddenly! Because I need a large random subset of files to test with, It was easy to notice when R18 discontinued videos and pulled the metadata for it. It really sucks to be honest! It might not be widespread, but it looks awful when you have a full collection, but 1 or 2 videos are empty because they can no longer be scraped.

stivify4 years ago (1 edit)

This is how KODI formatted looks like in Plex. Initially after running jav-it for the first time it seems ok with some minor issues like no DVD-ID and actor image. Subsequently running it over the same folder a few times (due to the new updates) many issues came. Titles become missing from the nfo. Some items got additional as the program thought that the trailer were also the actual movie and generate additional nfo fanart etc. The first time I didn't change to preserve original file names and subsequent runs it generates again and preserves files names but includes the previous generated items. Also when partially downloaded files ending with .bc will still be considered as a movie file and the items gets downloaded. After movie file download completed and running a second time the items gets re-downloaded. My local folder are also full of messy duplicate files. That's why I recommended that the jav-it can have a roll-back function to delete whatever generated previously before running it again so that such issues can be avoided.

current jav-it v1.51 in Plex.

an incomplete file with .bc! file extension gets downloaded with the files

extra files regenerated
extra files re-generated due to incomplete files with .bc! extension previously were detected as movie files

titles become missing in random nfo files

As for the tag called "JAV" it is important to some users because they didn't sort their files correctly in the first place. Only JAV movies require jav-it to be scraped hence it doesn't make sense for them to include their other collection in the same folder. The default shouldn't include this tag. It looks weird having to organise in movie type yet another tag for the same movie type. It isn't important just that OCD people will get annoyed by it.

jav-it4 years ago

Hi,

Thanks for the nice screenshots! Oh boy, where to start! (^_^); I don't know what "*.bc!" files are, and where your getting them. If your saying that these files are moved into folders and being cataloged, then that's a bug because Jav-It should not look for any file with a non-movie extensions. When you say "an incomplete file with .bc! file extension gets downloaded with the files", I'm a little confused as to what you mean.

From your screenshot, I can see you have multiple files called "*.mp4.nfo", "*.mp4.tbn", etc. Where did those files come from initialy? Some torrent you downloaded? Or was that extra data added by Plex during the import? Or was that created by Jav-It?

Perhaps to be clear, what was the name of the movie you tried to catalog before you ran Jav-It? "KCDA-296.mp4"? Or was it "KCDA-296.mp4.bc!" What were the exact comands you tried to run with Jav-It to get this undesired behaviour? Was it one command or many?

As to using alternate naming conventions with Jav-It, it is already warned in the command line help that existing cataloged files under different naming conventions are not removed. This is primarally a safety issue since deleting files is potentially destructive, especially if Jav-It has no idea how you tried to name things previously. Perhaps an override setting which blindly deletes everything except for the main video could be added as a cleaning mechanisim, but it would be a risky operation especially if your video is seperated into parts. For now, all I can recommend is do not run Jav-It multiple times using different naming conventions, unless you plan to manually review and clean files out yourself. Just pick one and stick to it. (^_^); For now anyways!

As for missing titles, if you can give me steps or something I can reproduce, I can definately try to understand where they are going. I'm pretty sure the multiple *.NFO file is causing your issue. If you simply choose a cataloging format and stick to it, then you'd likely be fine? Until I can program a cleaning switch, resetting yourelf will have to be done manually. But the easiest way I found is to simply do this:

- In your OS, do a find under your root folder for all *.jpg, *.tbn, *-trailer.*, .actors, and extrafanart, files and directories.
- Once you get a list of all the files found, just review them to make sure nothing was picked up by accident and delete them all in one shot.

Then you can start your scraping using a clean base. If your still getting issues after doing this, then let me know what steps your doing and I can try to reproduce what your seeing.

stivify4 years ago

Yes ".bc!" files are bitcomet incomplete downloaded files. The bitcomet placed an extension to the files until it is completed. Technically it should not be detected by Jav-it as a movie file. Apparently Jav-it still detects it as movie file which is a bug. The multiple files are created by Jav-it using a single command. Those ".bc!" files get downloaded with "*.mp4.nfo" or "*.mp4.tbn". Subsequently after the files completed download by bitcomet and changed to .mp4 extension, running Jav-it the second time on these files (using the same command) will download additional files with "*.nfo" or "*.tbn". Plex do not add extra files to the import. Ideally stopping Jav-it from detecting ".bc!" extensions or any other extension other than movie extension will solve this issue.

I only use this command, jav-it.exe catalog -d u:\Downloads --alt-naming-method="original" but it will come out multiple files from the same set of movies. For example "KCDA-296.mp4.bc!" was the initial file, running Jav-it will get "KCDA-296.mp4.nfo". Subsequently "KCDA-296.mp4", when running Jav-it again will have "KCDA-296.nfo".

Yes under alternate naming conventions with Jav-It, existing cataloged files under different naming conventions are not removed is correct, but I'm using the same naming convention. Extra files still get generated but with a "*.mp4.nfo" naming.

As for missing titles, I have no idea how to reproduce it because it happens randomly. I will try to delete all the files using your method and try to generate with a clean base and see how it goes.

jav-it4 years ago (2 edits)

Hi,

Thanks for the detailed description. Because I was able to clearly understand you, I have succesfully resolved the edge-case where *.bc! files are incorrectly being picked up as video files. Since the prefix is a valid video (and it was not foreseen users would try to catalog folders in a changing state), video files were being selected incorrectly based on a loose regex which has now been updated. You should be able to see change in the next version of Jav-It (Sometime this week or next). I suspect that with this change, all the extra files that are generated shold now go away. (^_^);

As for your missing titles, that one I am still unsure about. However, because of the strange edge-case you were trying to do, maybe that was the cause of it. There is a likely chance that by igoring *bc! files, a lot of this strangeness will go away.

itch.io

Viewing post in Pls add gui interface