Items that have been upgraded do count and contribute towards increasing your character's overall average item level. However, keep in mind that with 15-16 item slots; increasing a single item's level by +4/8 may not be sufficient to make an immediate impact.
