Board List | |
---|---|
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 11:22:06 PM #19 | skimmedmilktea posted... IllegalAlien posted...PonyLivesMatter posted...Wish I knew programming I don't think so. The main thing is practice. Although, I'm pretty deep in academia, programming is a way of thought. You train yourself to think in logical procedures, which you can naturally express in your code. It's just like playing an instrument or sport, some people have natural inclinations, but otherwise most of the field improves with practice. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 11:16:17 PM #18 | treewojima posted... I've been coding as a hobby for the past 15+ years and have dabbled in everything from simple GUI apps to 2D tiling graphics engines to homegrown operating systems (x86 only). Where should I look to learn more about AI and data analysis? I would watch Andrew Ng's course material on Coursera, and read his lecture notes from Stanford if you want more rigorous treatment. Best thing to do: grab some data and do analysis with it. scikit-learn provides the Python API for (classical) machine learning, and is extremely easy to use. Keras, etc provide deep learning APIs. I like Keras API because it's simple and terse like scikit-learn. The hardest part is gaining intuition in the problem. This requires a decent understanding of the math and trial/error. I didn't know my agent was doing so poorly until I kept trying to make it better haha --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 10:49:26 PM #13 | I modified the reward function so that pacman is constantly losing 1 point an action. This change and 33 games later and my pacman finally (sometimes) knows how to run the map to get points! 1310 point game atm, although the best was 2260 so far. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 6:01:16 PM #12 | PonyLivesMatter posted... Wish I knew programming It's never too late to learn haha.. just like any skill programming is best honed by practice. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 5:53:41 PM #10 | Completely refactored my code along with helpful comments: https://github.com/moduIo/Deep-Q-network A lot of things were wrong with the original code which was from a tutorial. I added the target network along with some other changes to hopefully make the agent learn --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 11:29:40 AM #9 | 100 games later and my agent is still stupid af. I think I would need to run for 10,000's of iterations to learn something. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 3:26:57 AM #7 | Haha nice there are actually at least 4 of us here. SBU is a great school I'm leaving in a week though to move to Denver... I hate the island so much. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | i keep a bottle of placenta from my birth. |
IllegalAlien 06/02/18 2:57:27 AM #20 | lmfao --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 2:49:18 AM #5 | The agent currently walks left as it's policy with a 10% random movement chance. 4 epochs in and still pretty stupid so far lol --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 1:22:39 AM #4 | I'm using this architecture now: # 3x3 Conv With batch size of 8 to reduce overhead since I'm just using my Macbook Air. I wish I had some real hardware so I could use a deeper CNN. Currently my best Pacman got 1060 points which is non-random. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 1:19:53 AM #3 | FightingGames posted...
Yeah Keras is so simple, but really TF is barely more verbose. I want to get better at TF to implement custom architectures. DQN is essentially just a CNN and regression haha --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Deep Reinforcement Learning in Python! |
IllegalAlien 06/02/18 12:35:49 AM #1 | I just implemented a deep reinforcement learning agent for Ms. Pacman using Deep Q-Network and OpenAI Gym. What an amazing time we live in. Run the code yourself: https://github.com/moduIo/Deep-Learning/blob/master/Reinforcement%20Learning/dqn.ipynb --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Anti-Immigrant Sentiment Is Most Extreme In States Without Immigrants |
IllegalAlien 05/31/18 6:12:23 PM #42 | Interesting study. It's good to experiment to confirm hypotheses are expressed in the data. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | GameRaven developer here. I have a new app |
IllegalAlien 05/22/18 11:37:38 AM #50 | Repo? --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Reading my wife's textbook for a sociology corse. |
IllegalAlien 05/17/18 10:42:45 PM #9 | Sociology is a beautiful subject you simps. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | A quick reminder that the actress playing Captain Marvel is Brie Larson |
IllegalAlien 05/09/18 11:20:23 AM #77 | When did CE literally become nothing but trolls and incels --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Baby Boomers are starting to retire and the economy is starting to tank. |
IllegalAlien 05/08/18 10:30:19 AM #38 | QassTank posted... @Zanzenburger posted...The gender wage gap isn't imaginary, Bro, not only does that article use misleading visuals (such as adding "volume" to the bars) it also clearly shows that women make 80% of men in the very first figure, which is hard to tell since they did their best to obfuscate the information. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | post some jazz |
IllegalAlien 05/05/18 1:36:49 AM #24 | SimpleMan posted... Aaron Diehl and Dominick Farinacci - Honeysuckle Rose Love Honeysuckle Rose! Django Reinhardt - Honeysuckle Rose --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | post some jazz |
IllegalAlien 05/05/18 1:16:53 AM #21 | Tangerine - Barney Kessel & Herb Ellis Barney Kessel - I've Grown Accustomed To Her Face Wes Montgomery - I've Grown Accustomed To Her Face --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | post some jazz |
IllegalAlien 05/05/18 1:12:57 AM #20 | Oscar Peterson Quartet (w/ Kessel) - Body And Soul MISTY by Joe Pass Oscar Peterson - That Old Black Magic --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | post some jazz |
IllegalAlien 05/05/18 1:09:49 AM #18 | Standards: Joe Pass - Stella By Starlight Bireli Lagrene & Sylvain Luc - stella by starlight Jazz In Marciac 2000 Wes Montgomery Trio - Days of Wine and Roses Barney Kessel - I Love You --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | post some jazz |
IllegalAlien 05/05/18 1:05:10 AM #14 | dodokiki posted... Yusef Lateef - Love Theme from The Robe My man Yusef is great --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | post some jazz |
IllegalAlien 05/05/18 1:04:49 AM #13 | Some staples: Miles Davis - So What Thelonious Monk Quartet - 'Round Midnight Django Reinhardt - Nuages John Coltrane - Blue Train --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | post some jazz |
IllegalAlien 05/05/18 1:02:14 AM #10 | John Coltrane - Giant steps Cannonball Adderley - Somethin' Else - Full Album https://www.youtube.com/playlist?list=PLTIb4fKCEAevQGcDKFIXdimOXsMK4uVNv --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | post some jazz |
IllegalAlien 05/05/18 12:59:57 AM #9 | The Dave Brubeck Quartet - Time Out - 1959 Wes Montgomery - Full House 1962 --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | post some jazz |
IllegalAlien 05/05/18 12:58:29 AM #7 | Joe Pass - Portraits of Duke Ellington (1974) Thelonious Monk - Straight, No Chaser John Coltrane - Stardust (1963) --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | post some jazz |
IllegalAlien 05/05/18 12:54:55 AM #4 | Oscar Peterson - Bossa Nova Oscar Peterson - Oscar Peterson Plays Harold Arlen https://www.youtube.com/playlist?list=PLhsDfrPehIe6Y5d55Ej1_PVnj_1sXA7cN Barney Kessel - Kessel Plays Standards https://www.youtube.com/watch?v=F24AvtAhyyE&list=PLyUvQYcownTgQNNdquaXd2msghckyOlip --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Changing my major to WRITING. Need advice. |
IllegalAlien 05/03/18 10:13:51 PM #19 | 3khc posted... @Romulox28 unsure what types of work I do good at. I suppose I dislike customer service and overall being fake in front if people. I'm fine working with a team if it's about us problem solving. Otherwise working alone is cool. I've only worked CS jobs. If I was single anthro might be an interesting lifestyle since I would probably be an archaeologist or social anthropologist. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Changing my major to WRITING. Need advice. |
IllegalAlien 05/02/18 11:58:19 AM #5 | I majored in anthropology until I had the realization that I didn't want to be poor forever. So I picked up computer science as a second major. Definitely a good thing to be more socially minded compared to CS students, especially now that literally all of the people I work with are foreigners. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Why do people say Trump is doing a bad job when everything is getting better |
IllegalAlien 04/29/18 10:31:48 PM #45 | "These numbers are not broken down by race, but it's a pretty good bet that black incomes have risen with those of other races under Trump." lmao. wow. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | That One Piece chapter! Holy crap |
IllegalAlien 04/29/18 12:07:06 AM #10 | ModLogic posted... imagine being so proud of stealing manga, or are we all going to pretend ya'll legally reading it? lmfao shut the fuck up --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | That One Piece chapter! Holy crap |
IllegalAlien 04/28/18 11:52:06 PM #8 | Big news! --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | What should I learn as my second programming language? |
IllegalAlien 04/28/18 10:40:07 PM #16 | DevsBro posted... IllegalAlien posted...DevsBro posted...IllegalAlien posted...After this realization you should try a non procedural/OO language such as Prolog or Scheme. Yeah you need to break the habit of writing procedural code. This is actually mostly a lie since it's easiest to write Prolog procedurally. The main thing is you need to really understand SLD resolution. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | What should I learn as my second programming language? |
IllegalAlien 04/28/18 10:33:40 PM #14 | DevsBro posted... IllegalAlien posted...After this realization you should try a non procedural/OO language such as Prolog or Scheme. Prolog is really nice for very specific applications. If you're a great Prolog programmer you can do some really elegant encodings. Compared to most people I'm a "good" Prolog programmer (I'm getting a paper published in TPLP 2018), but I'm complete shit compared to real Prolog programmers like my advisor and his advisor (my grand-advisor?). Evil_Evil_Evil_ posted... IllegalAlien posted...Of course somewhere in there you want to learn HTML/CSS/JS and a web stack like LAMP. IDK I used LAMP just 2 years ago to make some pretty nice websites including postholdings.com Every WordPress/Drupal site on the internet is LAMP. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | What should I learn as my second programming language? |
IllegalAlien 04/28/18 9:41:28 PM #8 | Of course somewhere in there you want to learn HTML/CSS/JS and a web stack like LAMP. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | What should I learn as my second programming language? |
IllegalAlien 04/28/18 9:40:37 PM #7 | Since you're still new I would do Python, then C++. After you've learned around 3 languages you start to realize that changing languages is mainly a change of syntax and cultural conventions. After this realization you should try a non procedural/OO language such as Prolog or Scheme. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Liberals furious at Whole Foods' 'Yellow Fever' restaurant. Claim it's racist. |
IllegalAlien 04/28/18 6:23:21 PM #38 | 0atmealcreampie posted... dameon_reaper posted...why people find it offensive. lol --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Trump to hold rally in Michigan tonight |
IllegalAlien 04/28/18 3:18:29 PM #8 | He needs to rally since it's plausible that he will be impeached. Google plausible before you start spamming bullshit at me. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Whole Foods created an unappetizing and racist named Asian-themed restaurant |
IllegalAlien 04/28/18 3:05:04 PM #11 | lmfao --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Best way to seek a graduate assistant position? |
IllegalAlien 04/27/18 1:00:03 PM #11 | I think GA positions are administrative roles. You'll be a helper for the administration staff. You probably want a TA position where you'll be assigned to an undergrad course to grade, etc. TAs might give priority to PhD students who don't have RA funding however. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | why don't you americans just come study in europe? |
IllegalAlien 04/27/18 12:42:48 PM #28 | Kurumiee posted... lesidesi posted...University education in the US is still of a higher quality than anywhere in the world Okay, but realistically you're not about to get into Oxford. A lot of European schools are quite good like ETH, etc. However the US has a ton of great schools many of which are public schools and cheap. Take the entire UC system which is better than all but the elite European schools. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | CNN: Courts were unfair to the boy who brought clock to school |
IllegalAlien 04/24/18 10:07:30 PM #10 | I'm amused --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Compsci majors, were you able to find work easily after graduation? |
IllegalAlien 04/23/18 8:34:35 PM #2 | Get an internship. I worked as a web dev during my senior year and stayed with the startup until I started my PhD program a year later. Most of what you learn in school is not relevant for a job. You need to learn whatever language they use at work plus a modern environment. The fundamentals from school help conceptually, but in practice youre going to need to crack open some programming books. I like OReilly, Packt, and Apress --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | Why do people even go to college? |
IllegalAlien 04/23/18 8:15:09 PM #23 | REMercsChamp posted... "why not just drop out of high school and do manual labor your whole life" Wasn't that literally your gimmick before? thecoolgu posted... ben1741 posted...$240000 If you go to a state school tuition will only cost you 40k total. Most state schools are just fine and if you're lucky enough to live somewhere with great state schools (like Cali) you're set. If you want to go private you'll have to pay something like 20-40k a year in tuition alone. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | I hate that my state legalized weed |
IllegalAlien 04/23/18 9:16:56 AM #42 | YOUHAVENOHOPE posted... >itt we acting like weed prices went up after legalization Word. For the quality that you can get for 25 an 1/8 it would normally cost 50-65 street. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Topic | I hate that my state legalized weed |
IllegalAlien 04/23/18 9:15:48 AM #41 | I cant fucking wait to move to Denver in June. Got a nice 2BR near DTC for barely more than what Im paying on Long Island for a section 8 1BR smh. --- "Never argue with an idiot, they drag you down to their level, then beat you with experience." |
Board List |