![[DEV] ISFL Forums](http://dev.sim-football.com/forums/images/emerald/logo.png "[DEV] ISFL Forums"){kind=logo}
+- [DEV] ISFL Forums (http://dev.sim-football.com/forums)
+-- Forum: Announcements (http://dev.sim-football.com/forums/forumdisplay.php?fid=495)
+--- Forum: Announcements (http://dev.sim-football.com/forums/forumdisplay.php?fid=32)
+---- Forum: Head Office Announcements (http://dev.sim-football.com/forums/forumdisplay.php?fid=230)
+---- Thread: Hawks - Wraiths Championship Announcement (/showthread.php?tid=3819)
Hawks - Wraiths Championship Announcement - Bzerkap - 08-29-2017
(08-29-2017, 01:46 PM)kckolbe Wrote:I was joking that because you won, you draft later in each round.yea ok. So let's make it totally fair then. @HENDRIX I will trade both my 6th rounders for your 4th
Hawks - Wraiths Championship Announcement - Bzerkap - 08-29-2017
(08-29-2017, 01:46 PM)timeconsumer Wrote:something something sorry for the offense?There was no offense to be sorry for
Hawks - Wraiths Championship Announcement - Gwdaja - 08-29-2017
(08-29-2017, 12:46 PM)kckolbe Wrote:I was joking that because you won, you draft later in each round.
Sorry, haven't had my coffee yet.
Hawks - Wraiths Championship Announcement - timeconsumer - 08-29-2017
(08-29-2017, 03:48 PM)Bzerkap Wrote:There was no offense to be sorry for
truth
Hawks - Wraiths Championship Announcement - 124715 - 08-29-2017
To be honest, how hard is it to automate this? If @7hawk77 and @Noppadet can make a webscraper that harvests TPE data, can't it be modified to collect attribute data? As long as all player pages are kept in a strict formatting, couldn't it work after some wrangling?
Hawks - Wraiths Championship Announcement - adam2552 - 08-29-2017
(08-29-2017, 04:42 PM)124715 Wrote:To be honest, how hard is it to automate this? If @7hawk77 and @Noppadet can make a webscraper that harvests TPE data, can't it be modified to collect attribute data? As long as all player pages are kept in a strict formatting, couldn't it work after some wrangling?
How would the web scraper validate the TPE links are correct?
Hawks - Wraiths Championship Announcement - 7hawk77 - 08-29-2017
(08-29-2017, 02:42 PM)124715 Wrote:To be honest, how hard is it to automate this? If @7hawk77 and @Noppadet can make a webscraper that harvests TPE data, can't it be modified to collect attribute data? As long as all player pages are kept in a strict formatting, couldn't it work after some wrangling?
This was something I was thinking about. Unsure, probably take way more time than the TPE scraper we did. That only needed to scrape like 20-24 pages. Getting updates will always have to scrape the number of pages that the number of players exist.
Basically it's complicated. I think a better solution would be to create some kind of character updater on a separate website... but that comes with all kinds of other complications.
Hawks - Wraiths Championship Announcement - 124715 - 08-29-2017
(08-29-2017, 04:46 PM)adam2552 Wrote:How would the web scraper validate the TPE links are correct?
Humans would check the links, and the machine could do the rest. I don't know if this would help, but we could just eliminate the spreadsheets altogether, and a human updates the player pages, letting the scraper take the attributes from there.
Hawks - Wraiths Championship Announcement - 37thchamber - 08-29-2017
(08-29-2017, 09:42 PM)124715 Wrote:To be honest, how hard is it to automate this?Technically, it's doable I reckon since player pages are already in a pretty uniform format afaik... but I don't know that this is really necessary. Conditional formatting in the update spreadsheet is probably just as effective and way simpler to implement.
Creating a web app for the league, specifically for updates -- which would supersede the spreadsheet and introduce a degree of automation to the process that would effectively eliminate errors -- is something I mentioned before but honestly the work required for that is ... not really worth the payoff imo. It would take a lot of time to build, even though it's not particularly difficult to do (in my head at least, the way I would do it)
Hawks - Wraiths Championship Announcement - Admin - 08-29-2017
(08-29-2017, 01:58 PM)37thchamber Wrote:Technically, it's doable I reckon since player pages are already in a pretty uniform format afaik... but I don't know that this is really necessary. Conditional formatting in the update spreadsheet is probably just as effective and way simpler to implement.I would love something automated for updates. It would be so much easier for new users.
Creating a web app for the league, specifically for updates -- which would supersede the spreadsheet and introduce a degree of automation to the process that would effectively eliminate errors -- is something I mentioned before but honestly the work required for that is ... not really worth the payoff imo. It would take a lot of time to build, even though it's not particularly difficult to do (in my head at least, the way I would do it)