Is this the cable that runs from the wall Jack to the router?

No. This cable runs from the router to the computer, or other Ethernet ready peripherals. It can also connect your cable or DSL gateway to your router. The cable that runs to the wall jack would be a regular (4 wire) phone cord with an in-line filter (for DSL).