Pasti bisa:
DELETE FROM `table1`, `table2` WHERE `orderId` = 500
lihat http://dev.mysql.com/doc/refman/ 5.0/en/delete.html
[EDIT:]
Ini trik lengkapnya:
DELETE FROM `orders`, `orders_items`
USING `orders`
INNER JOIN `orders_items` ON `orders`.`orderId` = `orders_items`.`orderId`
WHERE `orders`.`orderId`= 500
Jika orderId adalah varchar, maka ubah pernyataan menjadi = '500'
.