They had earlier seen Trophimus the Ephesian in the city with him, and assumed that Paul had brought him into the temple.
In context
27When the seven days were almost over, the Jews from Asia saw him in the temple, stirred up the whole crowd and seized him, 28shouting, “Men of Israel, help! This is the man who teaches everyone everywhere against our people, against the law and against this place. And now he has even brought Greeks into the temple and defiled this holy place.” 29They had earlier seen Trophimus the Ephesian in the city with him, and assumed that Paul had brought him into the temple. 30The whole city was thrown into turmoil, the people came running from every side, and they grabbed Paul and dragged him out of the temple; and at once the gates were shut. 31They were trying to kill him when word reached the commander of the cohort that all Jerusalem was in confusion.