Question about recitation 9

Question about recitation 9

Tomer Ben Moshe (guest) 03 Jul 2018 12:20

Hello,

In recitation 9 page 4 the last line I don't understand not the first equation and not the second equation.

If I understand correctly \phi(a|s;\theta)=P_t*a+(1-a)(1-P_t)

So how did it get to the first equation?

And for the second equation why did \nabla_\theta(P_t)=-x(s)?

Last edited on 03 Jul 2018 12:22 by Anonymous (79.176.67.x) Show more

Re: Question about recitation 9

adampolyak 03 Jul 2018 13:13

Thanks for pointing out the error - the scribe was fixed and clarified.

Tomer Ben Moshe (guest) 03 Jul 2018 13:35

Did you upload that? Because it still looks the same.

Tomer Ben Moshe (guest) 04 Jul 2018 05:08

I still don't understand the first equation.. What formula did you use? because
\phi(a|s;\theta)=P_t*a+(1-a)(1-P_t)

so

log(\phi(a|s;\theta))=log (P_t*a+(1-a)(1-P_t))

and you can't open that expession