Lurker > IllegalAlien

LurkerFAQs, Active DB, DB1, DB2, Database 3 ( 02.21.2018-07.23.2018 ), DB4, DB5, DB6, DB7, DB8, DB9, DB10, DB11, DB12, Clear
Board List
Page List: 1, 2, 3
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 11:22:06 PM
#19
skimmedmilktea posted...
IllegalAlien posted...
PonyLivesMatter posted...
Wish I knew programming

It's never too late to learn haha.. just like any skill programming is best honed by practice.

do you need school to learn programming?

I don't think so. The main thing is practice. Although, I'm pretty deep in academia, programming is a way of thought. You train yourself to think in logical procedures, which you can naturally express in your code.

It's just like playing an instrument or sport, some people have natural inclinations, but otherwise most of the field improves with practice.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 11:16:17 PM
#18
treewojima posted...
I've been coding as a hobby for the past 15+ years and have dabbled in everything from simple GUI apps to 2D tiling graphics engines to homegrown operating systems (x86 only). Where should I look to learn more about AI and data analysis?

I would watch Andrew Ng's course material on Coursera, and read his lecture notes from Stanford if you want more rigorous treatment.

Best thing to do: grab some data and do analysis with it.

scikit-learn provides the Python API for (classical) machine learning, and is extremely easy to use.

Keras, etc provide deep learning APIs. I like Keras API because it's simple and terse like scikit-learn.

The hardest part is gaining intuition in the problem. This requires a decent understanding of the math and trial/error. I didn't know my agent was doing so poorly until I kept trying to make it better haha
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 10:49:26 PM
#13
I modified the reward function so that pacman is constantly losing 1 point an action. This change and 33 games later and my pacman finally (sometimes) knows how to run the map to get points!

1310 point game atm, although the best was 2260 so far.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 6:01:16 PM
#12
PonyLivesMatter posted...
Wish I knew programming

It's never too late to learn haha.. just like any skill programming is best honed by practice.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 5:53:41 PM
#10
Completely refactored my code along with helpful comments: https://github.com/moduIo/Deep-Q-network

A lot of things were wrong with the original code which was from a tutorial. I added the target network along with some other changes to hopefully make the agent learn
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 11:29:40 AM
#9
100 games later and my agent is still stupid af.

I think I would need to run for 10,000's of iterations to learn something.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 3:26:57 AM
#7
Haha nice there are actually at least 4 of us here. SBU is a great school I'm leaving in a week though to move to Denver... I hate the island so much.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topici keep a bottle of placenta from my birth.
IllegalAlien
06/02/18 2:57:27 AM
#20
lmfao
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 2:49:18 AM
#5
The agent currently walks left as it's policy with a 10% random movement chance. 4 epochs in and still pretty stupid so far lol
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 1:22:39 AM
#4
I'm using this architecture now:

# 3x3 Conv
model.add(Conv2D(16, (3, 3), padding='same', input_shape=self.state_size))
model.add(Activation('relu'))

# 2x2 Pooling
model.add(MaxPooling2D(pool_size=(2, 2)))
model.add(Flatten())

# FC Layers
model.add(Dense(32, activation='relu'))
model.add(Dense(16, activation='relu'))
model.add(Dense(self.action_size, activation='linear'))


With batch size of 8 to reduce overhead since I'm just using my Macbook Air. I wish I had some real hardware so I could use a deeper CNN. Currently my best Pacman got 1060 points which is non-random.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 1:19:53 AM
#3
FightingGames posted...
# 3x3 Conv
model.add(Conv2D(8, (3, 3), padding='same', input_shape=self.state_size))
model.add(Activation('relu'))

# 2x2 Pooling
model.add(MaxPooling2D(pool_size=(2, 2)))
model.add(Flatten())

# FC Layers
model.add(Dense(16, activation='relu'))
model.add(Dense(self.action_size, activation='linear'))

model.compile(loss='mse', optimizer=Adam(lr=self.learning_rate))

only 7 lines of code needed to construct a neural NW? This is making my tensorflow code looking too verbose

Yeah Keras is so simple, but really TF is barely more verbose. I want to get better at TF to implement custom architectures. DQN is essentially just a CNN and regression haha
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicDeep Reinforcement Learning in Python!
IllegalAlien
06/02/18 12:35:49 AM
#1
I just implemented a deep reinforcement learning agent for Ms. Pacman using Deep Q-Network and OpenAI Gym.

What an amazing time we live in.

Run the code yourself: https://github.com/moduIo/Deep-Learning/blob/master/Reinforcement%20Learning/dqn.ipynb
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicAnti-Immigrant Sentiment Is Most Extreme In States Without Immigrants
IllegalAlien
05/31/18 6:12:23 PM
#42
Interesting study. It's good to experiment to confirm hypotheses are expressed in the data.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicGameRaven developer here. I have a new app
IllegalAlien
05/22/18 11:37:38 AM
#50
Repo?
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicReading my wife's textbook for a sociology corse.
IllegalAlien
05/17/18 10:42:45 PM
#9
Sociology is a beautiful subject you simps.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicA quick reminder that the actress playing Captain Marvel is Brie Larson
IllegalAlien
05/09/18 11:20:23 AM
#77
When did CE literally become nothing but trolls and incels
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicBaby Boomers are starting to retire and the economy is starting to tank.
IllegalAlien
05/08/18 10:30:19 AM
#38
QassTank posted...
@Zanzenburger posted...
The gender wage gap isn't imaginary,

Uhh...

You realize the whole wage gap statistic is entirely misleading, and that when it is adjusted for the same job position and hours worked, the wage gap vanishes, right?
http://www.ncpathinktank.org/pdfs/ba392.pdf

But it does seem interesting that it would be possible for the average boomer to not have a lot of savings while they are also predicted as having a huge effect on the market? Maybe the savings figure isn't counting stocks?

Bro, not only does that article use misleading visuals (such as adding "volume" to the bars) it also clearly shows that women make 80% of men in the very first figure, which is hard to tell since they did their best to obfuscate the information.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicpost some jazz
IllegalAlien
05/05/18 1:36:49 AM
#24
SimpleMan posted...
Aaron Diehl and Dominick Farinacci - Honeysuckle Rose


Charlie Parker - Cherokee

Love Honeysuckle Rose!

Django Reinhardt - Honeysuckle Rose

---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicpost some jazz
IllegalAlien
05/05/18 1:16:53 AM
#21
Tangerine - Barney Kessel & Herb Ellis


Barney Kessel - I've Grown Accustomed To Her Face


Wes Montgomery - I've Grown Accustomed To Her Face

---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicpost some jazz
IllegalAlien
05/05/18 1:12:57 AM
#20
Oscar Peterson Quartet (w/ Kessel) - Body And Soul


MISTY by Joe Pass


Oscar Peterson - That Old Black Magic

---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicpost some jazz
IllegalAlien
05/05/18 1:09:49 AM
#18
Standards:

Joe Pass - Stella By Starlight


Bireli Lagrene & Sylvain Luc - stella by starlight Jazz In Marciac 2000


Wes Montgomery Trio - Days of Wine and Roses


Barney Kessel - I Love You

---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicpost some jazz
IllegalAlien
05/05/18 1:05:10 AM
#14
dodokiki posted...
Yusef Lateef - Love Theme from The Robe

My man Yusef is great
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicpost some jazz
IllegalAlien
05/05/18 1:04:49 AM
#13
Some staples:

Miles Davis - So What


Thelonious Monk Quartet - 'Round Midnight


Django Reinhardt - Nuages


John Coltrane - Blue Train

---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicpost some jazz
IllegalAlien
05/05/18 1:02:14 AM
#10
John Coltrane - Giant steps


Cannonball Adderley - Somethin' Else - Full Album
https://www.youtube.com/playlist?list=PLTIb4fKCEAevQGcDKFIXdimOXsMK4uVNv
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicpost some jazz
IllegalAlien
05/05/18 12:59:57 AM
#9
The Dave Brubeck Quartet - Time Out - 1959


Wes Montgomery - Full House 1962

---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicpost some jazz
IllegalAlien
05/05/18 12:58:29 AM
#7
Joe Pass - Portraits of Duke Ellington (1974)


Thelonious Monk - Straight, No Chaser


John Coltrane - Stardust (1963)

---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicpost some jazz
IllegalAlien
05/05/18 12:54:55 AM
#4
Oscar Peterson - Bossa Nova


Oscar Peterson - Oscar Peterson Plays Harold Arlen
https://www.youtube.com/playlist?list=PLhsDfrPehIe6Y5d55Ej1_PVnj_1sXA7cN

Barney Kessel - Kessel Plays Standards
https://www.youtube.com/watch?v=F24AvtAhyyE&list=PLyUvQYcownTgQNNdquaXd2msghckyOlip
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicChanging my major to WRITING. Need advice.
IllegalAlien
05/03/18 10:13:51 PM
#19
3khc posted...
@Romulox28 unsure what types of work I do good at. I suppose I dislike customer service and overall being fake in front if people. I'm fine working with a team if it's about us problem solving. Otherwise working alone is cool.

@IllegalAlien what differences between anthro and CS did you notice in terms of job satisfaction?

@Guerrilla_Soldier for years I havent been able to focus on what career to pursure. I have been torn between my passion (film) and money/security (computer). At this point, I'm ready to take the plunge into passion. If I fail, what else have I got to lose? More time.

I've only worked CS jobs. If I was single anthro might be an interesting lifestyle since I would probably be an archaeologist or social anthropologist.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicChanging my major to WRITING. Need advice.
IllegalAlien
05/02/18 11:58:19 AM
#5
I majored in anthropology until I had the realization that I didn't want to be poor forever. So I picked up computer science as a second major. Definitely a good thing to be more socially minded compared to CS students, especially now that literally all of the people I work with are foreigners.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicWhy do people say Trump is doing a bad job when everything is getting better
IllegalAlien
04/29/18 10:31:48 PM
#45
"These numbers are not broken down by race, but it's a pretty good bet that black incomes have risen with those of other races under Trump."

lmao. wow.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicThat One Piece chapter! Holy crap
IllegalAlien
04/29/18 12:07:06 AM
#10
ModLogic posted...
imagine being so proud of stealing manga, or are we all going to pretend ya'll legally reading it? lmfao

disgusting even a mod blatantly boasting about stealing manga

shut

the

fuck

up
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicThat One Piece chapter! Holy crap
IllegalAlien
04/28/18 11:52:06 PM
#8
Big news!
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicWhat should I learn as my second programming language?
IllegalAlien
04/28/18 10:40:07 PM
#16
DevsBro posted...
IllegalAlien posted...
DevsBro posted...
IllegalAlien posted...
After this realization you should try a non procedural/OO language such as Prolog or Scheme.

I tried Prolog and I really liked a lot of the concepts but it was just so difficult to work with. Some of the syntaxes for more complex operations just felt like they were pulled out of thin air even though it's clearly just the normal syntaxes of the language linked together.

Prolog is really nice for very specific applications. If you're a great Prolog programmer you can do some really elegant encodings. Compared to most people I'm a "good" Prolog programmer (I'm getting a paper published in TPLP 2018), but I'm complete shit compared to real Prolog programmers like my advisor and his advisor (my grand-advisor?).

Well yeah you use it for recursive and FSM-like applications, which is something I could definitely have use for. But I just found it so difficult to learn.

Yeah you need to break the habit of writing procedural code. This is actually mostly a lie since it's easiest to write Prolog procedurally. The main thing is you need to really understand SLD resolution.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicWhat should I learn as my second programming language?
IllegalAlien
04/28/18 10:33:40 PM
#14
DevsBro posted...
IllegalAlien posted...
After this realization you should try a non procedural/OO language such as Prolog or Scheme.

I tried Prolog and I really liked a lot of the concepts but it was just so difficult to work with. Some of the syntaxes for more complex operations just felt like they were pulled out of thin air even though it's clearly just the normal syntaxes of the language linked together.

Prolog is really nice for very specific applications. If you're a great Prolog programmer you can do some really elegant encodings. Compared to most people I'm a "good" Prolog programmer (I'm getting a paper published in TPLP 2018), but I'm complete shit compared to real Prolog programmers like my advisor and his advisor (my grand-advisor?).

Evil_Evil_Evil_ posted...
IllegalAlien posted...
Of course somewhere in there you want to learn HTML/CSS/JS and a web stack like LAMP.


no one uses the lamp stack anymore

IDK I used LAMP just 2 years ago to make some pretty nice websites including postholdings.com

Every WordPress/Drupal site on the internet is LAMP.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicWhat should I learn as my second programming language?
IllegalAlien
04/28/18 9:41:28 PM
#8
Of course somewhere in there you want to learn HTML/CSS/JS and a web stack like LAMP.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicWhat should I learn as my second programming language?
IllegalAlien
04/28/18 9:40:37 PM
#7
Since you're still new I would do Python, then C++. After you've learned around 3 languages you start to realize that changing languages is mainly a change of syntax and cultural conventions.

After this realization you should try a non procedural/OO language such as Prolog or Scheme.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicLiberals furious at Whole Foods' 'Yellow Fever' restaurant. Claim it's racist.
IllegalAlien
04/28/18 6:23:21 PM
#38
0atmealcreampie posted...
dameon_reaper posted...
why people find it offensive.


No. I just don't understand why people revolve their whole existence over skin color.

The color of one's skin doesn't define ones character.

"yellow fever" sounds catchy to me. If people DIDN'T get so easily offended over such non-sense why would such a name not be a good name for a restaurant chain?

lol
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicTrump to hold rally in Michigan tonight
IllegalAlien
04/28/18 3:18:29 PM
#8
He needs to rally since it's plausible that he will be impeached.

Google plausible before you start spamming bullshit at me.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicWhole Foods created an unappetizing and racist named Asian-themed restaurant
IllegalAlien
04/28/18 3:05:04 PM
#11
lmfao
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicBest way to seek a graduate assistant position?
IllegalAlien
04/27/18 1:00:03 PM
#11
I think GA positions are administrative roles. You'll be a helper for the administration staff.

You probably want a TA position where you'll be assigned to an undergrad course to grade, etc. TAs might give priority to PhD students who don't have RA funding however.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Topicwhy don't you americans just come study in europe?
IllegalAlien
04/27/18 12:42:48 PM
#28
Kurumiee posted...
lesidesi posted...
University education in the US is still of a higher quality than anywhere in the world

There are extremely valid economic arguments that for profit maximisation, schools in the USA should charge even more than they do

I'm glad they dont, but that's the reality


that's where you're wrong. the best british and german universities rank above most american universities.

Okay, but realistically you're not about to get into Oxford. A lot of European schools are quite good like ETH, etc. However the US has a ton of great schools many of which are public schools and cheap. Take the entire UC system which is better than all but the elite European schools.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicCNN: Courts were unfair to the boy who brought clock to school
IllegalAlien
04/24/18 10:07:30 PM
#10
I'm amused
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicCompsci majors, were you able to find work easily after graduation?
IllegalAlien
04/23/18 8:34:35 PM
#2
Get an internship.

I worked as a web dev during my senior year and stayed with the startup until I started my PhD program a year later.

Most of what you learn in school is not relevant for a job. You need to learn whatever language they use at work plus a modern environment. The fundamentals from school help conceptually, but in practice youre going to need to crack open some programming books. I like OReilly, Packt, and Apress
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicWhy do people even go to college?
IllegalAlien
04/23/18 8:15:09 PM
#23
REMercsChamp posted...
"why not just drop out of high school and do manual labor your whole life"

Wasn't that literally your gimmick before?

thecoolgu posted...
ben1741 posted...
$240000

As a younger GameFAQs user...

Does your debt always have to be that much if you do go to college?

If you go to a state school tuition will only cost you 40k total. Most state schools are just fine and if you're lucky enough to live somewhere with great state schools (like Cali) you're set.

If you want to go private you'll have to pay something like 20-40k a year in tuition alone.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicI hate that my state legalized weed
IllegalAlien
04/23/18 9:16:56 AM
#42
YOUHAVENOHOPE posted...
>itt we acting like weed prices went up after legalization

lmfaooo

Word. For the quality that you can get for 25 an 1/8 it would normally cost 50-65 street.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
TopicI hate that my state legalized weed
IllegalAlien
04/23/18 9:15:48 AM
#41
I cant fucking wait to move to Denver in June. Got a nice 2BR near DTC for barely more than what Im paying on Long Island for a section 8 1BR smh.
---
"Never argue with an idiot, they drag you down to their level, then beat you with experience."
Board List
Page List: 1, 2, 3