Physical treatment of natural rubber or natural rubber containing material or chemical treatment of non-rubber portion thereof