Imo, it makes more sense to write the whole thing as one program. I'm a little confused as to why you would write a UI in Java if you're planning on making the back-end Python. It'd be more efficient, both for performance and for simplicity, to just have one table with an 'active' column that you filter on for display. When you're writing any kind of web-scraping bot, it's always a good idea to be considerate of the people whose services your program depends on. no retailer stock is going to fluctuate that frequently, and hitting their site so often would unnecessarily eat into their bandwidth usage (and may even get your IP blacklisted, depending on the retailer and how astute their IT guy is). You don't really need real-time data for this. but, on behalf of every e-commerce site out there, I would suggest making the minimum check interval somewhere around 15 minutes.
#PRICETRACKER SITES CODE#
Aside from being all-around prettier and easier to code for, it would also give you experience with the future of Java UI, rather than the past (not to mention it comes with a WebView control that makes HTML parsing and display a total joke). Purely based on my own, personal, subjective opinion, I would highly recommend JavaFX over Swing. This might make it a little more work to set up sites initially, but will make your code significantly less complicated and more accurate. There are lots of ways you might deal with this while still promoting code reuse, but I'll just give one suggestion: when you configure a new site for monitoring (not a new item), give your program the id of the page element to monitor. but, even if how you scrape/parse each website is the same, what data you look for and where is going to vary (potentially widely).
here's some food for thought though.Įxcellent idea. What do you guys think? Is this the best way to do it performance wise? Are there any problems you think I could run into in the future? Thanks I will track and store lowest price, stock availability dates and a few more statistics in the future but I want to get everything else working first. Probably XML and will be stored locally for now To implement this, I will have to dig up the information from XML data saved by the Java GUI program with Python to get an updated list of what to check for I will probably use Python + Beautiful Soup + lxml There will be 2 tables: 1 one will show all active checking entries while another will show all inactive checking entries There will be 2 "conditions"(size/stock related, price) that if met, will pop up an alertĬan decide frequency of checks (check website every single 30/40/etc. Probably going to make a simple Java swing GUI, aesthetics isn't a big concern right now Reuseable code, I would like to be able to just input the item link for different shopping websites instead of having to create a custom parser for each website Performance, it should be able to run in the background without slowing anything down I am a CS senior in college and have background in Java and Python. It will notify the user with some sort of alert if the size of the shirt the user wants comes in stock(assuming it was out of stock to begin with) or the shirt goes below a given price. I am trying to make a price tracker/size checker like for websites like JCrew and Bonobos except as a desktop application.
0 kommentar(er)
