West Ham won for the first time in the Premier League this season as their 1-0 victory piled fresh pressure on Aston Villa boss Steven Gerrard, while Newcastle's Allan Saint-Maximin rescued a 1-1 draw at Wolves on August 28.
David Moyes' side arrived at Villa Park sitting bottom of the table after losing their first three games without scoring a single goal.
Pablo Fornals' goal late in the second half ended West Ham's wait to get off the mark as they climbed out of the relegation zone.