Yes, you can enter specific measurements and weight for each item.  Click on the Edit icon for the desired product on the Product View page under Inventory. From the Edit Product page, click on the Organization tab.  Under Package Details, enter Length, Width and Height as well as weight. Select the appropriate unit for each. Click Apply.