Return-Path: <awaresystems.be+caf_=filtered=awaresystems.be@gmail.com>
Delivered-To: filtered@awaresystems.be
Received: from mx1.pub.mailpod2-cph3.one.com ([10.27.25.11])
	by mailstorage18.cst.mailpod2-cph3.one.com (Dovecot) with LMTP id fJbZDOYsXVpHxQAAQS8vrQ
	for <filtered@awaresystems.be>; Mon, 15 Jan 2018 22:43:00 +0000
X-HalOne-ID: 6f9d8936-fa45-11e7-afe6-e0d848957041
Received: from mail-oi0-f45.google.com (unknown [209.85.218.45])
	by mx1.pub.mailpod2-cph3.one.com (Halon) with ESMTPS
	id 6f9d8936-fa45-11e7-afe6-e0d848957041;
	Mon, 15 Jan 2018 22:42:59 +0000 (UTC)
Received: by mail-oi0-f45.google.com with SMTP id t16so9312306oif.10
        for <filtered@awaresystems.be>; Mon, 15 Jan 2018 14:42:59 -0800 (PST)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20161025;
        h=x-original-authentication-results:x-gm-message-state:delivered-to
         :to:references:from:message-id:date:user-agent:mime-version
         :in-reply-to:content-language:subject:precedence:list-id
         :list-unsubscribe:list-archive:list-post:list-help:list-subscribe
         :mime-version:sender:errors-to;
        bh=FsWplSwaBLVf7y9LCVZn14f3XEciOtua1JCYfPAaA6U=;
        b=aWZi35b7sFftdk+5bXSLncnb1I+H01jgpgQNUtfhS8OzvvjUiuQZJD39X5ASu8TKOO
         tuWpQ/IGocFzCaQWzoCQrQxeZq6VOcWhk+gHR/s3GFbKzyzMZXLqjK9fAWPvhv6c2AN+
         d6SjU2qulZalumKKV4VjDy4gQSDv8noIrkFnfFuot7NUqnFWx9yaxGgkpMIOpoA7Fj1U
         42oPzh+w8rKGwXpgGPuDkzkYBJcQIcmrVnpqeDWdDD8NHASL1cXwOagZgm6NXcnaeVmO
         tdoHspKThaL59ouUc+eJ5/+zefsRzOXr6/VmgHnb9G2VdOMqfXjBpAFIhF+jba4QNawx
         uRLQ==
X-Original-Authentication-Results: mx.google.com;       spf=neutral (google.com: 94.23.4.142 is neither permitted nor denied by best guess record for domain of tiff-bounces@lists.maptools.org) smtp.mailfrom=tiff-bounces@lists.maptools.org
X-Gm-Message-State: AKwxyteTj2r7OczolfIPg+KJ4lKffqYixh3gjU041KjODKebQCKNbR8w
	WuU/TIUgHhQ/GwCXIRfPTdPxicD8bkQ6i7RkZ/z34WegCOBrwU8=
X-Received: by 10.202.65.130 with SMTP id o124mr3714446oia.51.1516056178653;
        Mon, 15 Jan 2018 14:42:58 -0800 (PST)
X-Forwarded-To: filtered@awaresystems.be
X-Forwarded-For: awaresystems.be@gmail.com filtered@awaresystems.be
Delivered-To: awaresystems.be@gmail.com
Received: by 10.202.235.11 with SMTP id j11csp3417578oih;
        Mon, 15 Jan 2018 14:42:57 -0800 (PST)
X-Google-Smtp-Source: ACJfBouRiuGHCb+/JhCU4kGXs6iT1vChyWoX3Hb/cLL190oEyE7fT2394wcWXDKsVY6hvZViWD60
X-Received: by 10.223.153.52 with SMTP id x49mr21146787wrb.195.1516056177446;
        Mon, 15 Jan 2018 14:42:57 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; t=1516056177; cv=none;
        d=google.com; s=arc-20160816;
        b=S1//40PklD4eV+AS9Ydol4YySFrFv4hckXCGfFvq9t4nEDAkeMax2U1Q05fkgJMbdz
         QLdMxL1NrW2y1oQubWalbwkQb1srlPiUitNnMv+u5GhUFOc5cAzXzdFNqulfchPfvpQk
         DmLWTQADZ2h/wbyQtCMB9OPPnGY+hBDA9GbAC8FK+EJI/vtj1TO4CTx/HNYxCTZ4ZZXU
         ZBpxZHuf8BHeZYdDitVQisiF5FlonhB8TIt8MLqxzTYHc9l8JDo5VoOHXZCGYg875dsh
         ymyJRdZtIsMeNTZJ9VPf55qmS2plQLmSU6cll+sZtnV1UvoomEhBR4jPaFKp+K3HcWJU
         mizA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816;
        h=errors-to:sender:mime-version:list-subscribe:list-help:list-post
         :list-archive:list-unsubscribe:list-id:precedence:subject
         :content-language:in-reply-to:mime-version:user-agent:date
         :message-id:from:references:to:arc-authentication-results;
        bh=FsWplSwaBLVf7y9LCVZn14f3XEciOtua1JCYfPAaA6U=;
        b=wpj/WqTISS8gVQ6fbMjY9PklN1jdEUxZz3eps04H7A/7GTHVwSZFNUUEhtrYbS04uJ
         3qqzoGgrx73kTCvaNgicrXqR6SSCwTapJsjrpUWWyDPumggTVxfbvA4F9+D3VyroBuUO
         P4yCOE8+F45U9/HbX/WNT9aKksX0eUXqS8SOyoAgKgGgIRn/G6hp0iN414ZZCxOY8Aji
         BhPwECpCw1JFFgkPzUT3e8JPQAXE97g+EnKgMcF0N95W63RM6U8MlNucfmZ6GT4eBOJK
         zNNLMKg42o+rmih8wb/BpZY/GntpUjFPZbOvnNTXOEg/djI/K/JDdSiH0ACfsD+EH3+7
         P4tg==
ARC-Authentication-Results: i=1; mx.google.com;
       spf=neutral (google.com: 94.23.4.142 is neither permitted nor denied by best guess record for domain of tiff-bounces@lists.maptools.org) smtp.mailfrom=tiff-bounces@lists.maptools.org
Return-Path: <tiff-bounces@lists.maptools.org>
Received: from lists.maptools.org (ks365428.kimsufi.com. [94.23.4.142])
        by mx.google.com with ESMTP id p51si571103wrc.266.2018.01.15.14.42.56;
        Mon, 15 Jan 2018 14:42:57 -0800 (PST)
Received-SPF: neutral (google.com: 94.23.4.142 is neither permitted nor denied by best guess record for domain of tiff-bounces@lists.maptools.org) client-ip=94.23.4.142;
Authentication-Results: mx.google.com;
       spf=neutral (google.com: 94.23.4.142 is neither permitted nor denied by best guess record for domain of tiff-bounces@lists.maptools.org) smtp.mailfrom=tiff-bounces@lists.maptools.org
Received: from [10.1.0.241] (localhost.localdomain [127.0.0.1])
	by lists.maptools.org (Postfix) with ESMTP id 2A89035C069;
	Mon, 15 Jan 2018 17:42:02 -0500 (EST)
Received: from tux.cubewerx.com (cubewerx.com [206.248.148.2])
	by lists.maptools.org (Postfix) with ESMTPS id 92C9E35C066
	for <tiff@lists.maptools.org>; Mon, 15 Jan 2018 17:38:16 -0500 (EST)
Received: from craig.cubewerx.com
	(stjhnbsu1kw-47-55-58-153.dhcp-dynamic.fibreop.nb.bellaliant.net
	[47.55.58.153]) (authenticated bits=0)
	by tux.cubewerx.com (8.14.5/8.14.5) with ESMTP id w0FMcBcW031673
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO);
	Mon, 15 Jan 2018 17:38:12 -0500
To: tiff@lists.maptools.org
References: <39EE49FE-23A5-43DE-8998-51526287D182@larrygritz.com>
From: Craig Bruce <csbruce@cubewerx.com>
Message-ID: <88e395a3-99d6-94b3-6c28-d50777e5d7a4@cubewerx.com>
Date: Mon, 15 Jan 2018 18:38:11 -0400
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101
	Thunderbird/52.5.2
MIME-Version: 1.0
In-Reply-To: <39EE49FE-23A5-43DE-8998-51526287D182@larrygritz.com>
Content-Language: en-MW
X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7
	(tux.cubewerx.com [206.248.148.2]);
	Mon, 15 Jan 2018 17:38:12 -0500 (EST)
Subject: Re: [Tiff] Strategies for multi-core speedups
X-BeenThere: tiff@lists.maptools.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: TIFF and libtiff discussion <tiff.lists.maptools.org>
List-Unsubscribe: <http://lists.maptools.org/mailman/listinfo/tiff>,
	<mailto:tiff-request@lists.maptools.org?subject=unsubscribe>
List-Archive: <http://lists.maptools.org/mailman/private/tiff>
List-Post: <mailto:tiff@lists.maptools.org>
List-Help: <mailto:tiff-request@lists.maptools.org?subject=help>
List-Subscribe: <http://lists.maptools.org/mailman/listinfo/tiff>,
	<mailto:tiff-request@lists.maptools.org?subject=subscribe>
Content-Type: multipart/mixed; boundary="===============0642172933=="
Mime-version: 1.0
Sender: tiff-bounces@lists.maptools.org
Errors-To: tiff-bounces@lists.maptools.org

--===============0642172933==
Content-Type: text/html; charset=utf-8
Content-Language: en-MW
Content-Transfer-Encoding: 7bit

<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <div class="moz-cite-prefix">On 01/15/2018 03:17 PM, Larry Gritz
      wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:39EE49FE-23A5-43DE-8998-51526287D182@larrygritz.com">
      <pre wrap="">I tried to do this myself using libtiff -- for the common case of needing to read an entire image, my aim was read all the raw strips (TIFFReadRawStrip, serially), then dole them out to different threads to decompress in parallel (and when writing, compress in parallel, then TIFFWriteRawStrip each one serially). If libIlmImf is any indication, doing this on our typical 12 or 16 core machines ought to speed up TIFF I/O by an order of magnitude, easily.

But my plan was thwarted because it sure seems that the API for the codecs is inherently stateful and non-reentrant.</pre>
    </blockquote>
    Would it work if you opened the same file multiple times over with
    separate TIFF handles and read different sections of the image the
    normal way in different threads and then combined the results later?<br>
    <br>
    <div class="moz-signature">-- <br>
      Dr. Craig S. Bruce
      <br>
      Senior Software Developer
      <br>
      CubeWerx<i> </i>Inc.
      <br>
      <a href="http://www.cubewerx.com/">http://www.cubewerx.com</a></div>
  </body>
</html>

--===============0642172933==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Tiff mailing list: Tiff@lists.maptools.org
http://lists.maptools.org/mailman/listinfo/tiff
http://www.remotesensing.org/libtiff/
--===============0642172933==--
