Linking Databases, part 2

Posted in

#51 by Yorhel
2019-09-11 at 07:13
< report >Yup, that's looking pretty good. Now doing date + title prefix match and getting 10283 links, didn't find any bad matches in there on a quick scan.
(sorry for the ghetto HTML, my pastebin can't handle that many URLs... Also it links to the proxy for the poor souls who are blocked like me)
#52 by kumiko1
2019-09-11 at 12:21
< report >Looks good to me, everything I checked seems to be matched correctly.

Only stuff it's missing now is games where the original title is different, usually due to a formatting difference, but I guess we just have to do those manually, shouldn't be a problem.
#53 by Yorhel
2019-09-13 at 09:25
< report >Those EGS links have been imported now.

EDIT:
vndb=> select count(distinct l_egs) from releases where not hidden and l_egs <> 0;
count
-------
8352
(1 row)
That's about 35% of EGS, not bad at all.Last modified on 2019-09-13 at 10:28
#54 by kumiko1
2019-09-15 at 14:46
< report >Looking through a bunch of the VNs still missing, you could probably get a lot of them by making the matching a little more fuzzy. Things like ignoring whitespace, English capitalization, and differences between Japanese and English ! and ~ would go a long way, and with release date its unlikely you'd pick up false matches.
#55 by Ileca
2019-09-24 at 00:09
< report >I was thinking but adding doujinshi.org to staff would be interesting as artists most of the time have manga/doujinshi background. I randomly picked five artists who made something in the last ten years and got 4/5 results. In fact, I often use doujinshi.org to add links here.
Not sure if it's worth adding it to producers as well but I know it has some circles you can find here.

Edit: I added doujinshi.org to wikidata and tried then to add a doujinshi.org author ID by mimicking the pixiv ID property but it appears you must make a Property proposal for the property to be instated.Last modified on 2019-09-24 at 02:54
#56 by bathhouse-owner
2019-09-26 at 21:14
< report >Can you please add Fakku too? They also sell visual novels.
#57 by skorpiondeath
2019-09-28 at 13:54
< report >Hey guys Erogamescape link sometime is in Download release and sometime in Package release...which one is correct?
#58 by Yorhel
2019-09-28 at 14:52
< report >EGS doesn't make that distinction, the links can be added to all releases that correspond to the EGS entry. So the correct answer would typically be: Add to both.
#59 by skorpiondeath
2019-09-28 at 15:07
< report >ok thank you, probably best place should be directly attach erogetrailers, and EGS direclty to VN then
#60 by Yorhel
2019-09-28 at 15:19
< report >Unfortunately, no, that wouldn't work for a lot of VNs, because EGS does have different entries for different platforms and editions. Attaching the links to releases may result in some duplicated effort, but it is more accurate.
#61 by ecchihieronymus
2019-10-04 at 15:18
< report >Uhm, why has nobody mentioned neither Sol Press nor NekoNyan? I've seen the argument of 'not too many VNs avaiable' but I think it's pretty annoying that titles like Aokana don't have a link to their localisation companies shops? And with more and more VNs licensed it'd be smart to implement those two now. Just look at the list of TBA works for Sol Press and NekoNyan, that should be more than enough :D

Ideally the top link under 'Shops' should always be the shop for the company that translated/published it. In Aokana's case NekoNyan and in Onii-Kiss' case Sol Press (just as an example for Sol Press).
#62 by Ileca
2019-11-07 at 08:38
< report >
I was thinking but adding doujinshi.org to staff would be interesting as artists most of the time have manga/doujinshi background. I randomly picked five artists who made something in the last ten years and got 4/5 results. In fact, I often use doujinshi.org to add links here.
Not sure if it's worth adding it to producers as well but I know it has some circles you can find here.

Edit: I added doujinshi.org to wikidata and tried then to add a doujinshi.org author ID by mimicking the pixiv ID property but it appears you must make a Property proposal for the property to be instated.

Like you didn't answer me, Yorhel, I don't know if you didn't want to link to it or if you were waiting on me for adding the property, but I did it anyway.

Six freaking weeks to add a single property to wikidata. What a massive pain in the ass it was for such a simple task. It outranks MAL for the worse user contribution system... ok, maybe not.
I did some minor contributions to wikipedia like more than ten years ago but I had no idea it was such a mess and it really makes me wonder how the most popular website on the internet is so badly designed and how non power users can even contribute to it.
The documentation is garbage (or hidden) and I had to figure everything on my own by mimicking the neighbors. Of course, after you started, you have to fight with their template which makes you feel like you are editing the HTML directly. I want to see the faces of the noobs who decide to fix a simple mistake on wikipedia when they are hit by the markup filled gibberish they get when trying to edit.
When I created my request, I was welcomed by a big scary "error" using a word I never saw in my whole life and which is not on wordreference. I was supposed to "transclude" my request somewhere. Translation: I add to append my request to the queue myself... by editing the queue itself, which is just a text file. How fucking hard is it to automate the queuing of pending propositions?
Then, I waited (nice watchlist I couldn't set to give me notifications so I had to go there everyday to check) looking at all those football properties going off without a hitch before someone decided to... oppose my property because "doujinshi are mostly not notable". -_________-
I almost gave up at this point.
So I had to discuss... using the most godawful discussion system I ever saw. Once again, it's a text file you edit manually. I chatted for one year in a gogle sheet with three guys and I had no problem but for the life of me I can't figure on wikidata how to engage properly in a discussion without turning the discussion page into a slaughterhouse. Do I have to use indentations or bullets? How do I distinguish myself from someone else on the same indentation level? Why do I have to sign my own lines myself with markup? I am really curious to know what mechanics are behind the talk pages of wikipedia articles because it looks like magic to me.

I will stop here because I could go on and on and on forever like that time when I was supposed to "ping projects" because no one wanted to support my property or when they wanted to add constraints at all costs to the property to prevent doujinshika to be added to wikidata if they didn't proved themselves to be worthy of notice by doing "real manga" or games or whatever, not just crappy doujinshis.

So, here you go: doujinshi.org author ID. Do whatever you want with it.Last modified on 2019-11-07 at 08:50
#63 by Yorhel
2019-11-07 at 10:48
< report >Oh, I didn't realize you were looking for my feedback. Anyway, good job! I had been told that Wikidata had quite some bureaucracy when it came to policymaking and adding new properties, good to see that confirmed. I wasn't aware that Wikidata had such strict notability requirements in the first place...

Anyway, good work, I'll fetch those IDs and add them to VNDB.
#64 by skorpiondeath
2020-03-19 at 12:32
< report >Yorhel I'm not sure if it has been already asked but will you consider the possibility to add toranoana links (link) to VN?
Another thing is that I read that www.melonbooks.com it's blocked from outside Japan IPs.. in fact there's no way I can reach it. Strangely (or maybe not) I can reach melonbooks .jp (www.melonbooks.co.jp) there is a reson why we decided not to add those links?
#65 by Yorhel
2020-03-20 at 07:45
< report >Melonbooks: t2520.348

I still have a list of sites I'm planning to add, will look into that soon.
#66 by skorpiondeath
2020-03-20 at 07:51
< report >Thanks Yorhel, but...
.co.jp version doesn't have many VNs
mmm if the quantity of VN is a discriminating factor then probably toranoana should not be added
#67 by Yorhel
2020-03-20 at 07:57
< report >How many do they have? I'd say something like 50 is maybe enough for inclusion. I also don't have a clue how many VNs melonbooks.com have, so maybe I should be including them after all.
#68 by skorpiondeath
2020-03-20 at 08:21
< report >Mostly nukige but way more than 50. About melonbooks I personally should check out since I don't knowLast modified on 2020-03-20 at 08:21
#69 by kumiko1
2020-03-23 at 07:30
< report >Can confirm that both melonbooks.co.jp and toranoana have results in the thousands when you search for VNs.
#70 by Yorhel
2020-03-23 at 09:41
< report >Alright, four more shops can be added to releases: Nutaku, Game Jolt, Toranoana and Melonbooks.co.jp.

Lemme know if some links aren't properly recognized.
#71 by skorpiondeath
2020-03-23 at 11:06
< report >Insertion of both Toranoana and Melonbooks.co.jp worked fine but links are not showing in the links field: r47843Last modified on 2020-03-23 at 11:07
#72 by Yorhel
2020-03-23 at 11:19
< report >Hah, I totally forgot about the actually-displaying-the-links part. Will fix that later.

EDIT: Done.Last modified on 2020-03-23 at 15:23
#73 by beliar
2020-03-23 at 18:34
< report >Erm, Yorhel, I still cannot see Nutaku/Gamejolt links in the main VN page. I can only see them when I open the release. The same with Toranoana and Melonbooks.co.jp.Last modified on 2020-03-23 at 18:42
#74 by Ninigi
2020-03-23 at 19:27
< report >link

Err, seems we're missing an icon on the right-hand end of the release entry that will pop out a link list when we hover our cursor above it after the new update.Last modified on 2020-03-23 at 19:37
#75 by skorpiondeath
2020-03-24 at 12:50
< report >Yorhel sorry to bother again but I think it could be good to add also www.suruga-ya.jp there are lot of good information: catalog, JAN numbers, etc... (example link)
EDIT: just saw that some of the links have a different recap but they keep preserving the same id link
I also saw many VN in japanese amazon but I guess that's something we are avoiding willingly, right?Last modified on 2020-03-24 at 12:56